Skip to content

test: add test filter environment variable to cloud unit tests#142062

Merged
craig[bot] merged 1 commit intocockroachdb:masterfrom
kev-cao:test/cloud-unit-test-filter
Feb 27, 2025
Merged

test: add test filter environment variable to cloud unit tests#142062
craig[bot] merged 1 commit intocockroachdb:masterfrom
kev-cao:test/cloud-unit-test-filter

Conversation

@kev-cao
Copy link
Copy Markdown
Contributor

@kev-cao kev-cao commented Feb 27, 2025

Epic: none

Release note: None

@kev-cao kev-cao requested a review from a team as a code owner February 27, 2025 05:13
@cockroach-teamcity
Copy link
Copy Markdown
Member

This change is Reviewable

@kev-cao kev-cao requested review from DarrylWong and jeffswenson and removed request for DarrylWong February 27, 2025 05:13
Copy link
Copy Markdown
Collaborator

@jeffswenson jeffswenson left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@kev-cao
Copy link
Copy Markdown
Contributor Author

kev-cao commented Feb 27, 2025

TFTR!

bors r=jeffswenson

@craig
Copy link
Copy Markdown
Contributor

craig bot commented Feb 27, 2025

@craig craig bot merged commit 281a729 into cockroachdb:master Feb 27, 2025
24 checks passed
msbutler added a commit to msbutler/cockroach that referenced this pull request Feb 27, 2025
We already set the default rf to 1 for non system ranges. This patch removes a
schema change run to set num replicas for system ranges to 1 and sets the
system ranges rf to 1 by default instead. This patch reduces the test runtime
of server startup by abour 15%, post initialization:

```
❯ benchdiff --old  281a729 --new c14e2c15b8697e62a8916cd5c60a1be43c54fdf1 ./pkg/server -r BenchmarkTestServerStartup  -c 15 --preview -b
old:  281a729 Merge cockroachdb#142062 cockroachdb#142079
new:  c14e2c1 testserver: set default rf to 1 for single node se
args: benchdiff "--old" "281a7294cf1360446177ceed1e25e141d19e0c6e" "--new" "c14e2c15b8697e62a8916cd5c60a1be43c54fdf1" "./pkg/server" "-r" "BenchmarkTestServerStartup" "-c" "15" "--preview" "-b"

name                                   old time/op    new time/op    delta
TestServerStartup/ExternalTenant-24       390ms ±10%     320ms ±26%  -18.06%  (p=0.000 n=15+15)
TestServerStartup/SharedTenant-24         390ms ±16%     328ms ± 7%  -15.85%  (p=0.000 n=15+14)
TestServerStartup/SystemTenantOnly-24     386ms ±13%     336ms ±12%  -13.01%  (p=0.000 n=15+15)

name                                   old alloc/op   new alloc/op   delta
TestServerStartup/SystemTenantOnly-24     133MB ± 0%     119MB ± 0%  -10.21%  (p=0.000 n=15+15)
TestServerStartup/ExternalTenant-24       133MB ± 0%     119MB ± 1%  -10.19%  (p=0.000 n=12+15)
TestServerStartup/SharedTenant-24         133MB ± 1%     119MB ± 1%  -10.18%  (p=0.000 n=15+14)

name                                   old allocs/op  new allocs/op  delta
TestServerStartup/SystemTenantOnly-24      799k ± 0%      701k ± 0%  -12.34%  (p=0.000 n=15+15)
TestServerStartup/SharedTenant-24          799k ± 0%      701k ± 0%  -12.33%  (p=0.000 n=15+15)
TestServerStartup/ExternalTenant-24        799k ± 0%      701k ± 0%  -12.29%  (p=0.000 n=15+15)
```

Epic: none

Release note: none
msbutler added a commit to msbutler/cockroach that referenced this pull request Feb 27, 2025
We already set the default rf to 1 for non system ranges. This patch skips the
schema change run to set num replicas for system ranges to 1 and sets the
system ranges rf to 1 by default instead. This patch reduces the test runtime
of server startup by abour 15%, post initialization:

```
❯ benchdiff --old  281a729 --new c14e2c15b8697e62a8916cd5c60a1be43c54fdf1 ./pkg/server -r BenchmarkTestServerStartup  -c 15 --preview -b
old:  281a729 Merge cockroachdb#142062 cockroachdb#142079
new:  c14e2c1 testserver: set default rf to 1 for single node se
args: benchdiff "--old" "281a7294cf1360446177ceed1e25e141d19e0c6e" "--new" "c14e2c15b8697e62a8916cd5c60a1be43c54fdf1" "./pkg/server" "-r" "BenchmarkTestServerStartup" "-c" "15" "--preview" "-b"

name                                   old time/op    new time/op    delta
TestServerStartup/ExternalTenant-24       390ms ±10%     320ms ±26%  -18.06%  (p=0.000 n=15+15)
TestServerStartup/SharedTenant-24         390ms ±16%     328ms ± 7%  -15.85%  (p=0.000 n=15+14)
TestServerStartup/SystemTenantOnly-24     386ms ±13%     336ms ±12%  -13.01%  (p=0.000 n=15+15)

name                                   old alloc/op   new alloc/op   delta
TestServerStartup/SystemTenantOnly-24     133MB ± 0%     119MB ± 0%  -10.21%  (p=0.000 n=15+15)
TestServerStartup/ExternalTenant-24       133MB ± 0%     119MB ± 1%  -10.19%  (p=0.000 n=12+15)
TestServerStartup/SharedTenant-24         133MB ± 1%     119MB ± 1%  -10.18%  (p=0.000 n=15+14)

name                                   old allocs/op  new allocs/op  delta
TestServerStartup/SystemTenantOnly-24      799k ± 0%      701k ± 0%  -12.34%  (p=0.000 n=15+15)
TestServerStartup/SharedTenant-24          799k ± 0%      701k ± 0%  -12.33%  (p=0.000 n=15+15)
TestServerStartup/ExternalTenant-24        799k ± 0%      701k ± 0%  -12.29%  (p=0.000 n=15+15)
```

Epic: none

Release note: none
craig bot pushed a commit that referenced this pull request Feb 28, 2025
142108: testserver: set default rf to 1 for single node servers r=rafiss a=msbutler

We already set the default rf to 1 for non system ranges. This patch skips a schema change run to set num replicas for system ranges to 1 and sets the system ranges rf to 1 by default instead. This patch reduces the test runtime of server startup by abour 15%, post initialization:

```
❯ benchdiff --old  281a729 --new c14e2c15b8697e62a8916cd5c60a1be43c54fdf1 ./pkg/server -r BenchmarkTestServerStartup  -c 15 --preview -b
old:  281a729 Merge #142062 #142079
new:  c14e2c1 testserver: set default rf to 1 for single node se
args: benchdiff "--old" "281a7294cf1360446177ceed1e25e141d19e0c6e" "--new" "c14e2c15b8697e62a8916cd5c60a1be43c54fdf1" "./pkg/server" "-r" "BenchmarkTestServerStartup" "-c" "15" "--preview" "-b"

name                                   old time/op    new time/op    delta
TestServerStartup/ExternalTenant-24       390ms ±10%     320ms ±26%  -18.06%  (p=0.000 n=15+15)
TestServerStartup/SharedTenant-24         390ms ±16%     328ms ± 7%  -15.85%  (p=0.000 n=15+14)
TestServerStartup/SystemTenantOnly-24     386ms ±13%     336ms ±12%  -13.01%  (p=0.000 n=15+15)

name                                   old alloc/op   new alloc/op   delta
TestServerStartup/SystemTenantOnly-24     133MB ± 0%     119MB ± 0%  -10.21%  (p=0.000 n=15+15)
TestServerStartup/ExternalTenant-24       133MB ± 0%     119MB ± 1%  -10.19%  (p=0.000 n=12+15)
TestServerStartup/SharedTenant-24         133MB ± 1%     119MB ± 1%  -10.18%  (p=0.000 n=15+14)

name                                   old allocs/op  new allocs/op  delta
TestServerStartup/SystemTenantOnly-24      799k ± 0%      701k ± 0%  -12.34%  (p=0.000 n=15+15)
TestServerStartup/SharedTenant-24          799k ± 0%      701k ± 0%  -12.33%  (p=0.000 n=15+15)
TestServerStartup/ExternalTenant-24        799k ± 0%      701k ± 0%  -12.29%  (p=0.000 n=15+15)
```

Epic: none

Release note: none

Co-authored-by: Michael Butler <butler@cockroachlabs.com>
@kev-cao kev-cao deleted the test/cloud-unit-test-filter branch February 28, 2025 15:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants