Skip to content

.Net: Added a streaming flag to filter context models#9482

Merged
dmytrostruk merged 6 commits intomicrosoft:mainfrom
dmytrostruk:filters-context-streaming-flag
Oct 31, 2024
Merged

.Net: Added a streaming flag to filter context models#9482
dmytrostruk merged 6 commits intomicrosoft:mainfrom
dmytrostruk:filters-context-streaming-flag

Conversation

@dmytrostruk
Copy link
Member

Motivation and Context

Resolves: #7336

This PR adds a boolean flag to identify whether a filter is invoked within streaming or non-streaming mode. This provides an ability to use the same filter for both scenarios and access filter context data in easier way based on used mode.

Contribution Checklist

@dmytrostruk dmytrostruk self-assigned this Oct 30, 2024
@dmytrostruk dmytrostruk requested a review from a team as a code owner October 30, 2024 23:35
@markwallace-microsoft markwallace-microsoft added .NET Issue or Pull requests regarding .NET code kernel Issues or pull requests impacting the core kernel kernel.core labels Oct 30, 2024
@dmytrostruk dmytrostruk added this pull request to the merge queue Oct 31, 2024
Merged via the queue into microsoft:main with commit 44b6762 Oct 31, 2024
@dmytrostruk dmytrostruk deleted the filters-context-streaming-flag branch October 31, 2024 15:16
@eavanvalkenburg eavanvalkenburg added the needs_port_to_python Indicate this item needs to also be done for Python label Feb 18, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

kernel.core kernel Issues or pull requests impacting the core kernel needs_port_to_python Indicate this item needs to also be done for Python .NET Issue or Pull requests regarding .NET code

Projects

None yet

Development

Successfully merging this pull request may close these issues.

.Net: IFunctionInvocationFilter unable to differentiate between streaming and non-streaming invocation for KernelFunctionFromPrompt

4 participants