Skip to content

workload: support import parallelism for multi-tenant cluster#96904

Merged
craig[bot] merged 3 commits intocockroachdb:masterfrom
stevendanna:workload-mt
Feb 21, 2023
Merged

workload: support import parallelism for multi-tenant cluster#96904
craig[bot] merged 3 commits intocockroachdb:masterfrom
stevendanna:workload-mt

Conversation

@stevendanna
Copy link
Copy Markdown
Collaborator

All nodes now produce entries in the sql_instances table, so we are able to use that table to get a node count even when running against a secondary tenant.

I've kept the original query in place to support older clusters.

Fixes #78968

Release note: None

@stevendanna stevendanna requested a review from a team as a code owner February 9, 2023 21:17
@stevendanna stevendanna requested review from renatolabs and smg260 and removed request for a team February 9, 2023 21:17
@blathers-crl
Copy link
Copy Markdown

blathers-crl bot commented Feb 9, 2023

It looks like your PR touches production code but doesn't add or edit any test code. Did you consider adding tests to your PR?

🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.

@stevendanna stevendanna requested review from a team and dt February 9, 2023 21:17
@cockroach-teamcity
Copy link
Copy Markdown
Member

This change is Reviewable

Copy link
Copy Markdown
Contributor

@adityamaru adityamaru left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, i don't know if we have tests in workloadccl but in case you want to add a small unit test.

All nodes now produce entries in the sql_instances table, so we are
able to use that table to get a node count even when running against a
secondary tenant.

I've kept the original query in place to support older clusters.

Fixes cockroachdb#78968

Release note: None
I've run these under stress for a few hundred iterations and haven't
encountered a problem.

Release note: none
Copy link
Copy Markdown
Contributor

@adityamaru adityamaru left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@stevendanna
Copy link
Copy Markdown
Collaborator Author

bors r=adityamaru

@craig
Copy link
Copy Markdown
Contributor

craig bot commented Feb 21, 2023

Build succeeded:

@craig craig bot merged commit dd2749a into cockroachdb:master Feb 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

workload: use IMPORT parallelism proportional to available DistSQL pods in multi-tenant mode

3 participants