Skip to content

roachtest: tpccbench/nodes=9/cpu=4/multi-region failed #50142

@cockroach-teamcity

Description

@cockroach-teamcity

(roachtest).tpccbench/nodes=9/cpu=4/multi-region failed on provisional_202006091546_v20.1.2@92670dd72acad03bd9de54a197d66ef423a90183:

		Wraps: (11) /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-2006206-1591891794-80-n12cpu4-geo:8 -- ./workload run tpcc --warehouses=5000 --active-warehouses=950 --tolerate-errors --scatter --ramp=3m0s --duration=15m0s --partitions=3 --partition-affinity=1 {pgurl:5-7} --histograms=perf/warehouses=950/stats.json returned
		  | stderr:
		  |  load: could not scatter ranges: Couldn't exec "ALTER TABLE warehouse SCATTER": dial tcp 10.138.0.96:26257: connect: connection refused
		  | I200612 08:55:22.083614 1 workload/cli/run.go:362  retrying after error while creating load: could not scatter ranges: Couldn't exec "ALTER TABLE warehouse SCATTER": dial tcp 10.138.0.96:26257: connect: connection refused
		  | I200612 08:55:28.790641 1 workload/cli/run.go:362  retrying after error while creating load: could not scatter ranges: Couldn't exec "ALTER TABLE warehouse SCATTER": dial tcp 10.138.0.96:26257: connect: connection refused
		  | I200612 08:55:35.181112 1 workload/cli/run.go:362  retrying after error while creating load: could not scatter ranges: Couldn't exec "ALTER TABLE warehouse SCATTER": dial tcp 10.138.0.96:26257: connect: connection refused
		  | I200612 08:55:41.923210 1 workload/cli/run.go:362  retrying after error while creating load: could not scatter ranges: Couldn't exec "ALTER TABLE warehouse SCATTER": dial tcp 10.138.0.96:26257: connect: connection refused
		  |
		  | stdout:
		Wraps: (12) secondary error attachment
		  | signal: killed
		  | (1) signal: killed
		  | Error types: (1) *exec.ExitError
		Wraps: (13) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withMessage (3) *withstack.withStack (4) *errutil.withMessage (5) *withstack.withStack (6) *safedetails.withSafeDetails (7) *errutil.withMessage (8) *withstack.withStack (9) *safedetails.withSafeDetails (10) *errutil.withMessage (11) *main.withCommandDetails (12) *secondary.withSecondaryError (13) *errors.errorString

	cluster.go:1512,context.go:135,cluster.go:1501,test_runner.go:825: dead node detection: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod monitor teamcity-2006206-1591891794-80-n12cpu4-geo --oneshot --ignore-empty-nodes: exit status 1 4: skipped
		3: 21406
		1: 22201
		2: 20349
		8: skipped
		7: dead
		6: 21275
		5: 22034
		12: skipped
		10: 21904
		11: 22811
		9: 22588
		Error: UNCLASSIFIED_PROBLEM: 7: dead
		(1) UNCLASSIFIED_PROBLEM
		Wraps: (2) attached stack trace
		  | main.glob..func13
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1115
		  | main.wrap.func1
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:266
		  | github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra.(*Command).execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:766
		  | github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra.(*Command).ExecuteC
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:852
		  | github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra.(*Command).Execute
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:800
		  | main.main
		  | 	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1789
		  | runtime.main
		  | 	/usr/local/go/src/runtime/proc.go:203
		  | runtime.goexit
		  | 	/usr/local/go/src/runtime/asm_amd64.s:1357
		Wraps: (3) 3 safe details enclosed
		Wraps: (4) 7: dead
		Error types: (1) errors.Unclassified (2) *withstack.withStack (3) *safedetails.withSafeDetails (4) *errors.errorString

More

Artifacts: /tpccbench/nodes=9/cpu=4/multi-region
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

Metadata

Metadata

Assignees

Labels

C-test-failureBroken test (automatically or manually discovered).O-roachtestO-robotOriginated from a bot.release-blockerIndicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked.

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions