Skip to content

changefeedccl: assert increasing resolved message timestamps in validators#108861

Open
jayshrivastava wants to merge 2 commits intocockroachdb:masterfrom
jayshrivastava:cdctest-validator-resolved-ordering
Open

changefeedccl: assert increasing resolved message timestamps in validators#108861
jayshrivastava wants to merge 2 commits intocockroachdb:masterfrom
jayshrivastava:cdctest-validator-resolved-ordering

Conversation

@jayshrivastava
Copy link
Copy Markdown
Contributor

@jayshrivastava jayshrivastava commented Aug 16, 2023

streamingccl: fix incorrect usages of cdctest.Validator

The NoteResolved API on the cdctest.Validator requires that the passed
resolved timestamp is the resolved timetsamp / frontier for the whole set
of spans being tracked by the validator. Previously, tests would submit resolved
timestamps for subsets of spans at a time, which is incorrect. This would
not cause tests to fail because the order validator does not
assert that resolved timetsamps monotonically increase (tracked by #108872).
This change updates these tests to submit resolved timestamps for the
overall set of spans being tracked. After this change, fixing the
ordering validator in (#108872) will not cause these tests to fail.

Release note: None
Epic: None


changefeedccl: assert increasing resolved message timestamps in validators #108861

Previously, no validator in the cdctest package would assert that resolved messages increase monotonically. This is an important ordering guarantee that changefeeds provide.

This change updates the orderValidator to assert this.

Release note: None
Epic: None
Fixes: #108872

@cockroach-teamcity
Copy link
Copy Markdown
Member

This change is Reviewable

@jayshrivastava jayshrivastava force-pushed the cdctest-validator-resolved-ordering branch 4 times, most recently from 2a2eb38 to 963dd71 Compare August 28, 2023 17:40
@jayshrivastava jayshrivastava marked this pull request as ready for review August 28, 2023 18:58
@jayshrivastava jayshrivastava requested review from a team as code owners August 28, 2023 18:58
@jayshrivastava jayshrivastava requested review from lidorcarmel and miretskiy and removed request for a team August 28, 2023 18:58
The `NoteResolved` API on the `cdctest.Validator` requires that the passed
resolved timestamp is the resolved timetsamp / frontier for the whole set
of spans being tracked by the validator. Previously, tests would submit resolved
timestamps for subsets of spans at a time, which is incorrect. This would
not cause tests to fail because the order validator does not
assert that resolved timetsamps monotonically increase (tracked by cockroachdb#108872).
This change updates these tests to submit resolved timestamps for the
overall set of spans being tracked. After this change, fixing the
ordering validator in (cockroachdb#108872) will not cause these tests to fail.

Release note: None
Epic: None
…ators

Previously, no validator in the `cdctest` package would assert that resolved
messages increase monotonically. This is an important ordering guarantee that
changefeeds provide.

This change updates the `orderValidator` to assert this.

Release note: None
Epic: None
Fixes: cockroachdb#108872
@jayshrivastava jayshrivastava force-pushed the cdctest-validator-resolved-ordering branch from 963dd71 to 3366cfb Compare September 14, 2023 16:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

changefeedccl: order validator does not assert monotonic resolved messages

2 participants