Skip to content

Documentation of use_cache in llm_config #323

@rickyloynd-microsoft

Description

@rickyloynd-microsoft

@qingyun-wu informed me that llm_config has been used in the past to set use_cache, but this is not currently documented anywhere. Clear documentation is needed since our ChatCompletion.create method carries a use_cache argument, and users will hit a runtime error if they pass use_cache values through llm_config and directly to ChatCompletion.create at the same time.

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentation

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions