Is your feature request related to a problem? Please describe.
Hello. I am using AutoGen as a retrieval augmented generation agent. It works fantastically, and it performs multiple searches for different topics when necessary. However, building and sending the final answer takes a long time, too long for my users. I was hoping there is a way to stream just that one final answer, as it takes the majority of the time (Like 20 seconds out of 30 seconds total). I looked at all the open issues and pull requests and I am still not sure of the status of streaming with AutoGen.
Describe the solution you'd like
In the user_proxy agent class, have a parameter called stream_final_message = True.
This will allow all the agents to converse back and forth and pull whatever information is needed, but the final message is streamed so users don't have to wait for the entire formation of that message, because it tends to be long.
Additional context
No response
Is your feature request related to a problem? Please describe.
Hello. I am using AutoGen as a retrieval augmented generation agent. It works fantastically, and it performs multiple searches for different topics when necessary. However, building and sending the final answer takes a long time, too long for my users. I was hoping there is a way to stream just that one final answer, as it takes the majority of the time (Like 20 seconds out of 30 seconds total). I looked at all the open issues and pull requests and I am still not sure of the status of streaming with AutoGen.
Describe the solution you'd like
In the user_proxy agent class, have a parameter called stream_final_message = True.
This will allow all the agents to converse back and forth and pull whatever information is needed, but the final message is streamed so users don't have to wait for the entire formation of that message, because it tends to be long.
Additional context
No response