since the sdk routes through an api querying a database, there should be limit arguments in the sdk function calls. i noticed building a demo that the get_messages_for_session will return all messages. as they add up this will not only be an expensive query but will also exceed any useful threshold that could be handles in the context window of a language model.
since the sdk routes through an api querying a database, there should be limit arguments in the sdk function calls. i noticed building a demo that the
get_messages_for_sessionwill return all messages. as they add up this will not only be an expensive query but will also exceed any useful threshold that could be handles in the context window of a language model.