Skip to content

Conversation

@bartelink
Copy link
Collaborator

@bartelink bartelink commented Aug 31, 2021

Introduces a Source that traverses the complete content of an input that is not intrinsically representable as a change feed
that's incrementally walkable with some checkpointing mechanism

Crawls at a specified interval, checkpointing only when all data has been ingested successfully

@bartelink bartelink marked this pull request as ready for review September 2, 2021 09:47
@bartelink bartelink force-pushed the periodic-source branch 3 times, most recently from b7f1563 to fe2aabe Compare September 14, 2021 08:07
@bartelink bartelink merged commit 4938956 into master Oct 18, 2021
@bartelink bartelink deleted the periodic-source branch October 18, 2021 13:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants