@qingyun-wu informed me that llm_config has been used in the past to set use_cache, but this is not currently documented anywhere. Clear documentation is needed since our ChatCompletion.create method carries a use_cache argument, and users will hit a runtime error if they pass use_cache values through llm_config and directly to ChatCompletion.create at the same time.
@qingyun-wu informed me that
llm_confighas been used in the past to setuse_cache, but this is not currently documented anywhere. Clear documentation is needed since ourChatCompletion.createmethod carries ause_cacheargument, and users will hit a runtime error if they passuse_cachevalues throughllm_configand directly toChatCompletion.createat the same time.