-
Notifications
You must be signed in to change notification settings - Fork 4.1k
roachtest: tpccbench/nodes=9/cpu=4/multi-region failed [replica inconsistency] #69414
Copy link
Copy link
Closed
Closed
Copy link
Labels
C-test-failureBroken test (automatically or manually discovered).Broken test (automatically or manually discovered).O-roachtestO-robotOriginated from a bot.Originated from a bot.branch-masterFailures and bugs on the master branch.Failures and bugs on the master branch.release-blockerIndicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked.Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked.
Description
roachtest.tpccbench/nodes=9/cpu=4/multi-region failed with artifacts on master @ ab1fc343c9a1140191f96353995258e609a84d02:
| | /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/install/cockroach.go:412
| | github.com/cockroachdb/cockroach/pkg/cmd/roachprod/install.Cockroach.Start.func1
| | /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/install/cockroach.go:166
| | github.com/cockroachdb/cockroach/pkg/cmd/roachprod/install.(*SyncedCluster).ParallelE.func1.1
| | /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/install/cluster_synced.go:1709
| | runtime.goexit
| | /usr/local/go/src/runtime/asm_amd64.s:1371
| Wraps: (2) ~ ./cockroach.sh
| | �[0;1;31mJob for cockroach.service failed because the control process exited with error code.�[0m
| | �[0;1;31mSee "systemctl status cockroach.service" and "journalctl -xe" for details.�[0m
| Wraps: (3) exit status 1
| Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *exec.ExitError:
| I210826 12:54:50.179613 1 (gostd) cluster_synced.go:1677 [-] 1 command failed
Wraps: (2) exit status 1
Error types: (1) *cluster.WithCommandDetails (2) *exec.ExitError
cluster.go:1249,context.go:89,cluster.go:1237,test_runner.go:866: dead node detection: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod monitor teamcity-3359107-1629959017-35-n12cpu4-geo --oneshot --ignore-empty-nodes: exit status 1 1: 1287
3: 1312
2: 1418
4: skipped
7: dead (exit status 1)
6: 1334
5: 1311
10: 1470
11: 1440
8: skipped
9: 1435
12: skipped
Error: UNCLASSIFIED_PROBLEM: 7: dead (exit status 1)
(1) UNCLASSIFIED_PROBLEM
Wraps: (2) attached stack trace
-- stack trace:
| main.glob..func14
| /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:1173
| main.wrap.func1
| /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:281
| github.com/spf13/cobra.(*Command).execute
| /home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:856
| github.com/spf13/cobra.(*Command).ExecuteC
| /home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:960
| github.com/spf13/cobra.(*Command).Execute
| /home/agent/work/.go/src/github.com/cockroachdb/cockroach/vendor/github.com/spf13/cobra/command.go:897
| main.main
| /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachprod/main.go:2107
| runtime.main
| /usr/local/go/src/runtime/proc.go:225
| runtime.goexit
| /usr/local/go/src/runtime/asm_amd64.s:1371
Wraps: (3) 7: dead (exit status 1)
Error types: (1) errors.Unclassified (2) *withstack.withStack (3) *errutil.leafError
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
C-test-failureBroken test (automatically or manually discovered).Broken test (automatically or manually discovered).O-roachtestO-robotOriginated from a bot.Originated from a bot.branch-masterFailures and bugs on the master branch.Failures and bugs on the master branch.release-blockerIndicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked.Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked.