-
Notifications
You must be signed in to change notification settings - Fork 4.1k
roachtest: tpccbench/nodes=9/cpu=4/multi-region failed #50698
Description
(roachtest).tpccbench/nodes=9/cpu=4/multi-region failed on release-19.2@6318430c8f0ca0cafb9a34828c9ccdd7ecff68e1:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/tpccbench/nodes=9/cpu=4/multi-region/run_1
cluster.go:2484,tpcc.go:731,tpcc.go:572,test_runner.go:753: monitor failure: monitor task failed: output in run_113416.118_n4_workload_fixtures_load_tpcc: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-2041142-1593151731-84-n12cpu4-geo:4 -- ./workload fixtures load tpcc --warehouses=5000 --scatter --checks=false --partitions=3 --zones="us-east1-b,us-west1-b,europe-west2-b" {pgurl:1} returned: exit status 30
(1) attached stack trace
| main.(*monitor).WaitE
| /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2472
| main.(*monitor).Wait
| /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2480
| main.runTPCCBench
| /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tpcc.go:731
| main.registerTPCCBenchSpec.func1
| /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tpcc.go:572
| main.(*testRunner).runTest.func2
| /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:753
Wraps: (2) monitor failure
Wraps: (3) attached stack trace
| main.(*monitor).wait.func2
| /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2528
Wraps: (4) monitor task failed
Wraps: (5) attached stack trace
| main.(*cluster).RunE
| /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2115
| main.loadTPCCBench
| /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tpcc.go:639
| main.runTPCCBench.func1
| /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tpcc.go:729
| main.(*monitor).Go.func1
| /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2460
| golang.org/x/sync/errgroup.(*Group).Go.func1
| /home/agent/work/.go/pkg/mod/golang.org/x/sync@v0.0.0-20190911185100-cd5d95a43a6e/errgroup/errgroup.go:57
| runtime.goexit
| /usr/local/go/src/runtime/asm_amd64.s:1357
Wraps: (6) 2 safe details enclosed
Wraps: (7) output in run_113416.118_n4_workload_fixtures_load_tpcc
Wraps: (8) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-2041142-1593151731-84-n12cpu4-geo:4 -- ./workload fixtures load tpcc --warehouses=5000 --scatter --checks=false --partitions=3 --zones="us-east1-b,us-west1-b,europe-west2-b" {pgurl:1} returned
| stderr:
| 626 13:30:35.304099 23 ccl/workloadccl/fixture.go:586 loaded 86 GiB table customer in 1h56m16.299460443s (150000000 rows, 150000000 index entries, 13 MiB)
| I200626 15:29:27.449287 28 ccl/workloadccl/fixture.go:586 loaded 157 GiB table stock in 3h55m8.444650888s (500000000 rows, 500000000 index entries, 11 MiB)
| Error: restoring fixture: pq: importing 4044 ranges: change replicas of r14797 failed: descriptor changed: expected r14797:/Table/59/2/11{77/60065/1177/9/177/5-91/7835/1191/9/1379/3} [(n1,s1):1VOTER_OUTGOING, (n8,s8):2, (n5,s5):3, (n2,s2):4VOTER_INCOMING, next=5, gen=360, sticky=1593174860.806831483,0] != [actual] nil (range subsumed)
| Error: DEAD_ROACH_PROBLEM: exit status 1
| (1) DEAD_ROACH_PROBLEM
| Wraps: (2) Node 4. Command with error:
| | ```
| | ./workload fixtures load tpcc --warehouses=5000 --scatter --checks=false --partitions=3 --zones="us-east1-b,us-west1-b,europe-west2-b" {pgurl:1}
| | ```
| Wraps: (3) exit status 1
| Error types: (1) errors.Cockroach (2) *hintdetail.withDetail (3) *exec.ExitError
|
| stdout:
Wraps: (9) exit status 30
Error types: (1) *withstack.withStack (2) *errutil.withMessage (3) *withstack.withStack (4) *errutil.withMessage (5) *withstack.withStack (6) *safedetails.withSafeDetails (7) *errutil.withMessage (8) *main.withCommandDetails (9) *exec.ExitError
More
Artifacts: /tpccbench/nodes=9/cpu=4/multi-region
Related:
-
roachtest: tpccbench/nodes=9/cpu=4/multi-region failed #50518 roachtest: tpccbench/nodes=9/cpu=4/multi-region failed C-test-failure O-roachtest O-robot branch-provisional_202006220937_v19.2.8 release-blocker
-
roachtest: tpccbench/nodes=9/cpu=4/multi-region failed #50142 roachtest: tpccbench/nodes=9/cpu=4/multi-region failed C-test-failure O-roachtest O-robot branch-provisional_202006091546_v20.1.2 release-blocker
-
roachtest: tpccbench/nodes=9/cpu=4/multi-region failed #48255 roachtest: tpccbench/nodes=9/cpu=4/multi-region failed C-test-failure O-roachtest O-robot branch-master release-blocker
-
roachtest: tpccbench/nodes=9/cpu=4/multi-region failed #46343 roachtest: tpccbench/nodes=9/cpu=4/multi-region failed C-test-failure O-roachtest O-robot branch-release-19.1 release-blocker
See this test on roachdash
powered by pkg/cmd/internal/issues