Describe the Request

There are some common patterns that users may want to apply to object streams on the producer or consumer side.

The producer may want to (1) batch objects, (2) publish a sample of the incoming stream, (3) apply aggregation functions to the stream before publishing. The consumer may want to sample the incoming stream or filter the stream according to metadata.

While not an exhaustive list, we can add support for these mechanisms via plugins / additional parameters. For example, the StreamProducer can take an aggregator: Callable[list[T], T].

Sample Code

No response