Skip to content

roachtest: add test for admission control disk bandwidth #124160

Merged
craig[bot] merged 1 commit intocockroachdb:masterfrom
aadityasondhi:20240508.disk-bw-test
May 21, 2024
Merged

roachtest: add test for admission control disk bandwidth #124160
craig[bot] merged 1 commit intocockroachdb:masterfrom
aadityasondhi:20240508.disk-bw-test

Conversation

@aadityasondhi
Copy link
Copy Markdown
Contributor

@aadityasondhi aadityasondhi commented May 14, 2024

This test runs a single node target cluster that has two workloads
running on it. The lower priority (qos=background) is very bandwidth
intensive, and without the AC bandwidth limiter would saturate the
provisioned bandwidth (controlled using cgroups).

This test shows how setting the cluster setting
kvadmission.store.provisioned-bandwidth limits the disk bandwidth
usage of lower priority work and shapes it at the value set in the
setting.

Fixes #121576.

Release note: None

@cockroach-teamcity
Copy link
Copy Markdown
Member

This change is Reviewable

@aadityasondhi aadityasondhi force-pushed the 20240508.disk-bw-test branch 3 times, most recently from b856133 to 3d01c24 Compare May 15, 2024 18:50
@aadityasondhi aadityasondhi changed the title 20240508.disk bw test roachtest: add test for admission control disk bandwidth May 15, 2024
@aadityasondhi aadityasondhi force-pushed the 20240508.disk-bw-test branch 8 times, most recently from 744a03d to 8c17890 Compare May 15, 2024 22:12
@aadityasondhi aadityasondhi marked this pull request as ready for review May 15, 2024 22:13
@aadityasondhi aadityasondhi requested a review from a team as a code owner May 15, 2024 22:13
@aadityasondhi aadityasondhi requested review from a team, nameisbhaskar, sumeerbhola and vidit-bhat and removed request for a team May 15, 2024 22:13
This test runs a single node target cluster that has two workloads
running on it. The lower priority (qos=background) is very bandwidth
intensive, and without the AC bandwidth limiter would saturate the
provisioned bandwidth (controlled using cgroups).

This test shows how setting the cluster setting
`kvadmission.store.provisioned-bandwidth` limits the disk bandwidth
usage of lower priority work and shapes it at the value set in the
setting.

Fixes cockroachdb#121576.

Release note: None
@aadityasondhi aadityasondhi force-pushed the 20240508.disk-bw-test branch from 8c17890 to f23b867 Compare May 16, 2024 21:03
@aadityasondhi
Copy link
Copy Markdown
Contributor Author

Link to grafana dashboard showing this.

Note: I manually adjusted setting in that run to show how the shaping is working. In this test, we set those limits right away and assert on never going too far past the provisioned limit.

@aadityasondhi aadityasondhi added the backport-24.1.x Flags PRs that need to be backported to 24.1. label May 17, 2024
Copy link
Copy Markdown
Collaborator

@sumeerbhola sumeerbhola left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:lgtm:

Reviewed 3 of 3 files at r1, all commit messages.
Reviewable status: :shipit: complete! 1 of 0 LGTMs obtained (waiting on @nameisbhaskar and @vidit-bhat)

Copy link
Copy Markdown
Contributor Author

@aadityasondhi aadityasondhi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TFTR!

bors r=sumeerbhola

Reviewable status: :shipit: complete! 1 of 0 LGTMs obtained (waiting on @nameisbhaskar and @vidit-bhat)

@craig craig bot merged commit 7807ee2 into cockroachdb:master May 21, 2024
@craig
Copy link
Copy Markdown
Contributor

craig bot commented May 21, 2024

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport-24.1.x Flags PRs that need to be backported to 24.1.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

admission: roachtest for disk bandwidth limiter

3 participants