Skip to content

roachtest: rebalance/by-load/replicas/mixed-version failed #161339

@cockroach-teamcity

Description

@cockroach-teamcity

Note: This build has runtime assertions enabled. If the same failure was hit in a run without assertions enabled, there should be a similar failure without this message. If there isn't one, then this failure is likely due to an assertion violation or (assertion) timeout.

roachtest.rebalance/by-load/replicas/mixed-version failed with artifacts on master @ 377adba1a7814b2b18b3ad19462efbd9c8226b98:

Failed with:

(mixedversion.go:901).Run: mixed-version test failure while running step 31 (run "rebalance load run"): CPU not evenly balanced after timeout: outside bounds mean=73.2 tolerance=20.0% (±14.6) bounds=[58.6, 87.9]
	below  = []
	within = [s1: 69 (-4.8%), s3: 66 (-9.7%), s4: 71 (-2.8%), s5: 71 (-1.8%), s6: 71 (-2.7%)]
	above  = [s2: 89 (+21.8%)]
test artifacts and logs in: /artifacts/rebalance/by-load/replicas/mixed-version/run_1

Cluster Node to Ip Mapping:

Node Public IP Private IP
teamcity-20992783-1768633008-103-n7cpu4-0001 20.127.238.28 10.1.0.109
teamcity-20992783-1768633008-103-n7cpu4-0002 20.62.251.168 10.1.0.114
teamcity-20992783-1768633008-103-n7cpu4-0003 20.102.97.151 10.1.0.134
teamcity-20992783-1768633008-103-n7cpu4-0004 20.121.139.202 10.1.0.116
teamcity-20992783-1768633008-103-n7cpu4-0005 20.127.168.155 10.1.0.112
teamcity-20992783-1768633008-103-n7cpu4-0006 20.127.196.183 10.1.0.135
teamcity-20992783-1768633008-103-n7cpu4-0007 20.55.92.67 10.1.0.117

Parameters:

  • arch=amd64
  • cloud=azure
  • coverageBuild=false
  • cpu=4
  • diskCount=0
  • encrypted=false
  • fs=ext4
  • localSSD=true
  • mvtDeploymentMode=system-only
  • mvtVersions=v25.3.7 → v25.4.3 → v26.2.0-alpha.00000000-dev-377adba1a7814b2b18b3ad19462efbd9c8226b98 (master)
  • runtimeAssertionsBuild=true
Help

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

/cc @cockroachdb/kv-triage

This test on roachdash | Improve this report!

Jira issue: CRDB-58806

Metadata

Metadata

Assignees

Labels

A-testingTesting tools and infrastructureB-runtime-assertions-enabledC-bugCode not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior.C-test-failureBroken test (automatically or manually discovered).O-roachtestO-robotOriginated from a bot.P-3Issues/test failures with no fix SLAT-kvKV TeamX-nostaleMarks an issue/pr that should be ignored by the stale botbranch-masterFailures and bugs on the master branch.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions