Skip to content

[Inference API] Add ability to specify secret settings during the endpoint update operation for Llama service if secret settings weren't provided at the endpoint creation #140888

@Jan-Kazlouski-elastic

Description

@Jan-Kazlouski-elastic

Description

During the work on _update operation fixes.
#140003 (comment)
For Llama service it is possible to provide and not to provide secret settings during the endpoint creation. However during the endpoint update it is not possible to add secret settings if they were not provided during the creation.
EmptySecretSettings are added during the creation if api_key param is not specified in service_settings. newSecretSettings method of EmptySecretSettings class returns empty instance without updating it.

Metadata

Metadata

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions