-
Notifications
You must be signed in to change notification settings - Fork 4.1k
roachtest: rebalance/by-load/replicas/mixed-version failed #161339
Copy link
Copy link
Open
Labels
A-testingTesting tools and infrastructureTesting tools and infrastructureB-runtime-assertions-enabledC-bugCode not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior.Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior.C-test-failureBroken test (automatically or manually discovered).Broken test (automatically or manually discovered).O-roachtestO-robotOriginated from a bot.Originated from a bot.P-3Issues/test failures with no fix SLAIssues/test failures with no fix SLAT-kvKV TeamKV TeamX-nostaleMarks an issue/pr that should be ignored by the stale botMarks an issue/pr that should be ignored by the stale botbranch-masterFailures and bugs on the master branch.Failures and bugs on the master branch.
Description
Note: This build has runtime assertions enabled. If the same failure was hit in a run without assertions enabled, there should be a similar failure without this message. If there isn't one, then this failure is likely due to an assertion violation or (assertion) timeout.
roachtest.rebalance/by-load/replicas/mixed-version failed with artifacts on master @ 377adba1a7814b2b18b3ad19462efbd9c8226b98:
Failed with:
(mixedversion.go:901).Run: mixed-version test failure while running step 31 (run "rebalance load run"): CPU not evenly balanced after timeout: outside bounds mean=73.2 tolerance=20.0% (±14.6) bounds=[58.6, 87.9]
below = []
within = [s1: 69 (-4.8%), s3: 66 (-9.7%), s4: 71 (-2.8%), s5: 71 (-1.8%), s6: 71 (-2.7%)]
above = [s2: 89 (+21.8%)]
test artifacts and logs in: /artifacts/rebalance/by-load/replicas/mixed-version/run_1
Cluster Node to Ip Mapping:
| Node | Public IP | Private IP |
|---|---|---|
| teamcity-20992783-1768633008-103-n7cpu4-0001 | 20.127.238.28 | 10.1.0.109 |
| teamcity-20992783-1768633008-103-n7cpu4-0002 | 20.62.251.168 | 10.1.0.114 |
| teamcity-20992783-1768633008-103-n7cpu4-0003 | 20.102.97.151 | 10.1.0.134 |
| teamcity-20992783-1768633008-103-n7cpu4-0004 | 20.121.139.202 | 10.1.0.116 |
| teamcity-20992783-1768633008-103-n7cpu4-0005 | 20.127.168.155 | 10.1.0.112 |
| teamcity-20992783-1768633008-103-n7cpu4-0006 | 20.127.196.183 | 10.1.0.135 |
| teamcity-20992783-1768633008-103-n7cpu4-0007 | 20.55.92.67 | 10.1.0.117 |
Parameters:
arch=amd64cloud=azurecoverageBuild=falsecpu=4diskCount=0encrypted=falsefs=ext4localSSD=truemvtDeploymentMode=system-onlymvtVersions=v25.3.7 → v25.4.3 → v26.2.0-alpha.00000000-dev-377adba1a7814b2b18b3ad19462efbd9c8226b98 (master)runtimeAssertionsBuild=true
Help
See: roachtest README
See: How To Investigate (internal)
Grafana is not yet available for azure clusters
This test on roachdash | Improve this report!
Jira issue: CRDB-58806
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
A-testingTesting tools and infrastructureTesting tools and infrastructureB-runtime-assertions-enabledC-bugCode not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior.Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior.C-test-failureBroken test (automatically or manually discovered).Broken test (automatically or manually discovered).O-roachtestO-robotOriginated from a bot.Originated from a bot.P-3Issues/test failures with no fix SLAIssues/test failures with no fix SLAT-kvKV TeamKV TeamX-nostaleMarks an issue/pr that should be ignored by the stale botMarks an issue/pr that should be ignored by the stale botbranch-masterFailures and bugs on the master branch.Failures and bugs on the master branch.