Skip to content

roachtest: stop using deprecated API in c2c tests#131940

Merged
craig[bot] merged 1 commit intocockroachdb:masterfrom
renatolabs:rc/roachtest-c2c-deprecated-api
Oct 4, 2024
Merged

roachtest: stop using deprecated API in c2c tests#131940
craig[bot] merged 1 commit intocockroachdb:masterfrom
renatolabs:rc/roachtest-c2c-deprecated-api

Conversation

@renatolabs
Copy link
Copy Markdown

@renatolabs renatolabs commented Oct 4, 2024

This commit stops using the deprecated multitenant functions from
multitenant_utils. Instead, we use the "official" roachprod API.

These tests were the last one still using the old API, so we also
remove the multitenant_utils.go file entirely in this commit.

Fixes: #115867

Release note: None

@renatolabs renatolabs requested a review from a team as a code owner October 4, 2024 17:53
@renatolabs renatolabs requested review from DarrylWong and herkolategan and removed request for a team October 4, 2024 17:53
@blathers-crl
Copy link
Copy Markdown

blathers-crl bot commented Oct 4, 2024

Your pull request contains more than 1000 changes. It is strongly encouraged to split big PRs into smaller chunks.

🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.

@cockroach-teamcity
Copy link
Copy Markdown
Member

This change is Reviewable

@renatolabs
Copy link
Copy Markdown
Author

Builds on top of #131847. I'll rebase once that one merges.

This commit stops using the deprecated multitenant functions from
`multitenant_utils.` Instead, we use the "official" roachprod API.

These tests were the last one still using the old API, so we also
remove the `multitenant_utils.go` file entirely in this commit.

Fixes: cockroachdb#117673

Release note: None
@renatolabs renatolabs force-pushed the rc/roachtest-c2c-deprecated-api branch from c98b523 to 4ceb24a Compare October 4, 2024 19:23
Copy link
Copy Markdown
Contributor

@DarrylWong DarrylWong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@renatolabs
Copy link
Copy Markdown
Author

c2c tests passed.

TFTR!

bors r=DarrylWong

@craig
Copy link
Copy Markdown
Contributor

craig bot commented Oct 4, 2024

@craig craig bot merged commit a80bdf2 into cockroachdb:master Oct 4, 2024
msbutler added a commit to msbutler/cockroach that referenced this pull request Nov 13, 2024
The c2c perf tests histoically have not run a backup schedule on the source. A
recent refactor (cockroachdb#131940), lead to backups running on the source. During full
backup execution, cpu utilization exceeded 90%, leading to overload and
replication lag higher than 2 minutes. This patch removes the backup schedule.

At some point, we should run the c2c tests with a backup schedule, but that
would require more hardware or more ac pacing work to stabilize the test. These
are not priorities now.

Fixes cockroachdb#133233

Release note: none
craig bot pushed a commit that referenced this pull request Nov 13, 2024
134997: crosscluster/logical: commit planner txn early r=dt a=msbutler

During large scale testing, we have seen the CreateForTables remote rpc take
several seconds or even minutes in LDR planning, and was previously within
scope of the planner txn, which could in turn cause txn refresh errors. This
patch commits the planner txn earlier in the job hook, before the
CreateForTables call, to prevent the planner txn from retrying. Now, the
destination side schema validation, locking, and job writing occur in a
subsequent txn.

Epic: none

Release note: none

135071: roachtest: skip running backup schedule on c2c source r=dt a=msbutler

The c2c perf tests histoically have not run a backup schedule on the source. A recent refactor (#131940), lead to backups running on the source. During full backup execution, cpu utilization exceeded 90%, leading to overload and replication lag higher than 2 minutes. This patch removes the backup schedule.

At some point, we should run the c2c tests with a backup schedule, but that would require more hardware or more ac pacing work to stabilize the test. These are not priorities now.

Fixes #133233

Release note: none

135072: roachtest: use unsafe incompatible restore in OR tests r=dt a=msbutler

We need to create new fixtures, but that currently takes time. This quiets the test failures.

Fixes #134663
Fixes #134659

Release note: none

Co-authored-by: Michael Butler <butler@cockroachlabs.com>
blathers-crl bot pushed a commit that referenced this pull request Nov 13, 2024
The c2c perf tests histoically have not run a backup schedule on the source. A
recent refactor (#131940), lead to backups running on the source. During full
backup execution, cpu utilization exceeded 90%, leading to overload and
replication lag higher than 2 minutes. This patch removes the backup schedule.

At some point, we should run the c2c tests with a backup schedule, but that
would require more hardware or more ac pacing work to stabilize the test. These
are not priorities now.

Fixes #133233

Release note: none
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

roachtest: port multitenant tests to new roachprod APIs

3 participants