Skip to content

Java: Issue with getStreamingChatCompletionsAsync() and getChatCompletionsStream() methods after integrating semantic-kernel #3001

@thomaspeng90s

Description

@thomaspeng90s

I encountered an issue after integrating semantic-kernel into my project. When attempting to use the ChatCompletion to call the methods getStreamingChatCompletionsAsync() or getChatCompletionsStream(), I receive the following error:

com.azure.core.exception.HttpResponseException: Status code 400, "{
  "error": {
    "message": "None is not of type 'object' - 'logit_bias'",
    "type": "invalid_request_error",
    "param": null,
    "code": null
  }
}
"

Upon investigation, I found that semantic kernel is currently using the azure-ai-openai dependency version 1.0.0-beta.2:

com.azure
azure-ai-openai
1.0.0-beta.2

However, it appears that the SDK has already been upgraded to version 1.0.0-beta.5. When I directly reference the 1.0.0-beta.5 version, the methods work as expected.

I would appreciate any guidance or solutions to this issue. Thank you.

Metadata

Metadata

Assignees

No one assigned

    Labels

    javaIssue or PR regarding Java code

    Type

    No type

    Projects

    Status

    Sprint: Done

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions