Skip to content

roachtest: tpccbench/nodes=9/cpu=4/multi-region failed #54258

@cockroach-teamcity

Description

@cockroach-teamcity

(roachtest).tpccbench/nodes=9/cpu=4/multi-region failed on release-20.2@09786094a013b45e4d794f9cb02a4256f70b9158:

		Wraps: (5) attached stack trace
		  -- stack trace:
		  | main.(*cluster).RunE
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2284
		  | main.loadTPCCBench
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tpcc.go:687
		  | main.runTPCCBench.func1
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tpcc.go:783
		  | main.(*monitor).Go.func1
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2626
		  | golang.org/x/sync/errgroup.(*Group).Go.func1
		  | 	/home/agent/work/.go/pkg/mod/golang.org/x/sync@v0.0.0-20190911185100-cd5d95a43a6e/errgroup/errgroup.go:57
		  | runtime.goexit
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1357
		Wraps: (6) output in run_111344.355_n4_workload_fixtures_load_tpcc
		Wraps: (7) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-2262030-1599804450-73-n12cpu4-geo:4 -- ./workload fixtures load tpcc --warehouses=5000 --scatter --checks=false --partitions=3 --zones="us-east1-b,us-west1-b,europe-west2-b" {pgurl:1} returned
		  | stderr:
		  | I200911 11:13:47.295453 1 ccl/workloadccl/cliccl/fixtures.go:279  starting restore of 9 tables
		  | I200911 11:14:05.253946 88 ccl/workloadccl/fixture.go:586  loaded 4.9 MiB table district in 16.578754476s (50000 rows, 0 index entries, 304 KiB)
		  | I200911 11:14:32.912995 87 ccl/workloadccl/fixture.go:586  loaded 266 KiB table warehouse in 44.237759947s (5000 rows, 0 index entries, 6.0 KiB)
		  | I200911 11:16:13.973394 93 ccl/workloadccl/fixture.go:586  loaded 7.8 MiB table item in 2m25.298339769s (100000 rows, 0 index entries, 55 KiB)
		  | I200911 11:18:38.410674 92 ccl/workloadccl/fixture.go:586  loaded 641 MiB table new_order in 4m49.735558401s (45000000 rows, 0 index entries, 2.2 MiB)
		  | I200911 11:33:56.342037 91 ccl/workloadccl/fixture.go:586  loaded 6.7 GiB table order in 20m7.666753134s (150000000 rows, 150000000 index entries, 5.7 MiB)
		  | I200911 12:13:58.497125 90 ccl/workloadccl/fixture.go:586  loaded 21 GiB table history in 1h0m9.822074668s (150000000 rows, 300000000 index entries, 6.1 MiB)
		  | Error: restoring fixture: pq: unexpected metadata &{Ranges:[] Err:communication error: rpc error: code = Canceled desc = context canceled
		  | (1) candidate pg code: 58C01
		  | Wraps: (2) attached stack trace
		  |   -- stack trace:
		  |   | github.com/cockroachdb/cockroach/pkg/sql/flowinfra.processInboundStreamHelper.func2
		  |   | 	/go/src/github.com/cockroachdb/cockroach/pkg/sql/flowinfra/inbound.go:139
		  |   | runtime.goexit
		  |   | 	/usr/local/go/src/runtime/asm_amd64.s:1357
		  | Wraps: (3) secondary error attachment
		  |   | rpc error: code = Canceled desc = context canceled
		  |   | (1) rpc error: code = Canceled desc = context canceled
		  |   | Error types: (1) *status.Error
		  | Wraps: (4) communication error: rpc error: code = Canceled desc = context canceled
		  | Error types: (1) *pgerror.withCandidateCode (2) *withstack.withStack (3) *secondary.withSecondaryError (4) *errutil.leafError TraceData:[] LeafTxnFinalState:<nil> RowNum:<nil> SamplerProgress:<nil> BulkProcessorProgress:<nil> Metrics:<nil>}
		  | Error: COMMAND_PROBLEM: exit status 1
		  | (1) COMMAND_PROBLEM
		  | Wraps: (2) Node 4. Command with error:
		  |   | ```
		  |   | ./workload fixtures load tpcc --warehouses=5000 --scatter --checks=false --partitions=3 --zones="us-east1-b,us-west1-b,europe-west2-b" {pgurl:1}
		  |   | ```
		  | Wraps: (3) exit status 1
		  | Error types: (1) errors.Cmd (2) *hintdetail.withDetail (3) *exec.ExitError
		  |
		  | stdout:
		Wraps: (8) exit status 20
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *withstack.withStack (6) *errutil.withPrefix (7) *main.withCommandDetails (8) *exec.ExitError

More

Artifacts: /tpccbench/nodes=9/cpu=4/multi-region
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions