cmd/roachtest: tweaks to sstable corruption test#77675
Merged
craig[bot] merged 1 commit intocockroachdb:masterfrom Mar 14, 2022
Merged
cmd/roachtest: tweaks to sstable corruption test#77675craig[bot] merged 1 commit intocockroachdb:masterfrom
craig[bot] merged 1 commit intocockroachdb:masterfrom
Conversation
A few minor changes to the existing roachtest: Reduce the warehouse count on ingest back to 100 - this should be ample, and it matches the warehouse count on the read path in a later part of the test. Change the stop options to wait until the process has been terminated before continuing. Re-work the command to search for SSTables to corrupt - use tables from the most recent manifest (if multiple are present); consider SSTables with either a start or end key representing a user table; shuffle tables to distribute corruption over the LSM; perform filtering in the bash command rather than in the test runner itself. Release justification: Roachtest-only change. Release note: None. Touches cockroachdb#77321.
Member
|
This change is |
Collaborator
Author
|
I also did a stress test of this, and it came back clean. That's not to say this fixes whatever is causing #77321, just that the test still works as expected. |
Collaborator
Author
|
I walk back the comment about the stress test not failing. I ran it again and hit what seems to be #77627. That's unrelated to the changes, but thought I'd mention it. |
itsbilal
approved these changes
Mar 14, 2022
Contributor
itsbilal
left a comment
There was a problem hiding this comment.
Reviewed 1 of 1 files at r1, all commit messages.
Reviewable status:complete! 1 of 0 LGTMs obtained (waiting on @nicktrav)
pkg/cmd/roachtest/tests/sstable_corruption.go, line 56 at r1 (raw file):
c.Stop(ctx, t.L(), opts, crdbNodes) const findTablesCmd = "" +
Nice!
Collaborator
Author
|
TFTR! bors r=itsbilal |
Contributor
|
Build succeeded: |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
A few minor changes to the existing roachtest:
Reduce the warehouse count on ingest back to 100 - this should be ample,
and it matches the warehouse count on the read path in a later part of
the test.
Change the stop options to wait until the process has been terminated
before continuing.
Re-work the command to search for SSTables to corrupt - use tables from
the most recent manifest (if multiple are present); consider SSTables
with either a start or end key representing a user table; shuffle tables
to distribute corruption over the LSM; perform filtering in the bash
command rather than in the test runner itself.
Release justification: Roachtest-only change.
Release note: None.
Touches #77321.