Skip to content

Conversation

@bartelink
Copy link
Collaborator

@bartelink bartelink commented Feb 12, 2021

Adds an optional Purge Interval to streams scheduler, which removes synced streams immediately after the state has been emitted

@bartelink
Copy link
Collaborator Author

Leaving this here as unbounded memory consumption growth is obviously unacceptable in many contexts and that issue remains. (TL;DR it matters if you have millions of unique ephemeral streams in your system that are all fed into a long-running Sink - in many cases you'll have natural process recycling and/or may be able to filter events prior to feeding them into the projector in the first place)

It may be that a more drastic solution (drop all state and do a more complete reset etc) is justified - a purge in many contexts might reasonably happen in intervals measured in hours or days.

@bartelink bartelink changed the base branch from master to remove-destructurama July 28, 2022 07:11
@bartelink bartelink marked this pull request as ready for review July 28, 2022 13:27
Base automatically changed from remove-destructurama to master July 28, 2022 15:14
@bartelink bartelink merged commit 96f2dac into master Jul 28, 2022
@bartelink bartelink deleted the purge-interval branch July 28, 2022 15:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants