-
Notifications
You must be signed in to change notification settings - Fork 4.1k
roachtest: tpccbench/nodes=9/cpu=4/multi-region failed #54137
Description
(roachtest).tpccbench/nodes=9/cpu=4/multi-region failed on release-20.1@273b49d542d897d6f3b4f06d52322cbe77b0b436:
-- stack trace:
| main.(*monitor).wait.func2
| /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2692
Wraps: (4) monitor task failed
Wraps: (5) attached stack trace
-- stack trace:
| main.runTPCCBench.func3.1
| /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tpcc.go:881
| [...repeated from below...]
Wraps: (6) error running tpcc load generator
Wraps: (7) attached stack trace
-- stack trace:
| main.(*cluster).RunE
| /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2284
| main.runTPCCBench.func3.1
| /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tpcc.go:878
| main.(*monitor).Go.func1
| /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2626
| golang.org/x/sync/errgroup.(*Group).Go.func1
| /home/agent/work/.go/pkg/mod/golang.org/x/sync@v0.0.0-20190911185100-cd5d95a43a6e/errgroup/errgroup.go:57
| runtime.goexit
| /usr/local/go/src/runtime/asm_amd64.s:1357
Wraps: (8) output in run_172434.306_n8_workload_run_tpcc
Wraps: (9) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-2254917-1599631042-75-n12cpu4-geo:8 -- ./workload run tpcc --warehouses=5000 --active-warehouses=991 --tolerate-errors --scatter --ramp=3m0s --duration=15m0s --partitions=3 --partition-affinity=1 {pgurl:5-7} --histograms=perf/warehouses=991/stats.json returned
| stderr:
| I200909 17:24:37.645084 1 workload/cli/run.go:356 creating load generator...
| E200909 17:36:21.792311 1 workload/cli/run.go:379 Attempt to create load generator failed. It's been more than 10m0s since we started trying to create the load generator so we're giving up. Last failure: failed to initialize the load generator: preparing
| UPDATE district
| SET d_next_o_id = d_next_o_id + 1
| WHERE d_w_id = $1 AND d_id = $2
| RETURNING d_tax, d_next_o_id: context deadline exceeded
| Error: failed to initialize the load generator: preparing
| UPDATE district
| SET d_next_o_id = d_next_o_id + 1
| WHERE d_w_id = $1 AND d_id = $2
| RETURNING d_tax, d_next_o_id: context deadline exceeded
| Error: COMMAND_PROBLEM: exit status 1
| (1) COMMAND_PROBLEM
| Wraps: (2) Node 8. Command with error:
| | ```
| | ./workload run tpcc --warehouses=5000 --active-warehouses=991 --tolerate-errors --scatter --ramp=3m0s --duration=15m0s --partitions=3 --partition-affinity=1 {pgurl:5-7} --histograms=perf/warehouses=991/stats.json
| | ```
| Wraps: (3) exit status 1
| Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
|
| stdout:
| Initializing 1982 connections...
| Initializing 9910 workers and preparing statements...
Wraps: (10) exit status 20
Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *withstack.withStack (6) *errutil.withPrefix (7) *withstack.withStack (8) *errutil.withPrefix (9) *main.withCommandDetails (10) *exec.ExitError
More
Artifacts: /tpccbench/nodes=9/cpu=4/multi-region
Related:
-
roachtest: tpccbench/nodes=9/cpu=4/multi-region failed [congmgr assertion failed] #53540 roachtest: tpccbench/nodes=9/cpu=4/multi-region failed [congmgr assertion failed] C-test-failure O-roachtest O-robot branch-provisional_202008261913_v20.2.0-beta.1
-
roachtest: tpccbench/nodes=9/cpu=4/multi-region failed #53443 roachtest: tpccbench/nodes=9/cpu=4/multi-region failed C-test-failure O-roachtest O-robot branch-provisional_202008241848_v20.1.5
-
roachtest: tpccbench/nodes=9/cpu=4/multi-region failed #48255 roachtest: tpccbench/nodes=9/cpu=4/multi-region failed C-test-failure O-roachtest O-robot branch-master release-blocker
See this test on roachdash
powered by pkg/cmd/internal/issues