-
Notifications
You must be signed in to change notification settings - Fork 4.1k
roachtest: restore2TB/nodes=32 failed [raft recv oom, reproducible] #80155
Copy link
Copy link
Closed
Labels
C-test-failureBroken test (automatically or manually discovered).Broken test (automatically or manually discovered).O-roachtestO-robotOriginated from a bot.Originated from a bot.S-3Medium-low impact: incurs increased costs for some users (incl lower avail, recoverable bad data)Medium-low impact: incurs increased costs for some users (incl lower avail, recoverable bad data)branch-masterFailures and bugs on the master branch.Failures and bugs on the master branch.
Description
roachtest.restore2TB/nodes=32 failed with artifacts on master @ 1fdbb16fa206c5fd77c3aa111ec40916edfb55df:
| main/pkg/cmd/roachtest/monitor.go:105
| golang.org/x/sync/errgroup.(*Group).Go.func1
| golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:57
| runtime.goexit
| GOROOT/src/runtime/asm_amd64.s:1581
Wraps: (2) output in run_090427.112984326_n1_cockroach_sql
Wraps: (3) ./cockroach sql --insecure -e "
| RESTORE csv.bank FROM
| 'gs://cockroach-fixtures/workload/bank/version=1.0.0,payload-bytes=10240,ranges=0,rows=65104166,seed=1/bank?AUTH=implicit'
| WITH into_db = 'restore2tb'" returned
| stderr:
|
| stdout:
Wraps: (4) secondary error attachment
| UNCLASSIFIED_PROBLEM: context canceled
| (1) UNCLASSIFIED_PROBLEM
| Wraps: (2) Node 1. Command with error:
| | ``````
| | ./cockroach sql --insecure -e "
| | RESTORE csv.bank FROM
| | 'gs://cockroach-fixtures/workload/bank/version=1.0.0,payload-bytes=10240,ranges=0,rows=65104166,seed=1/bank?AUTH=implicit'
| | WITH into_db = 'restore2tb'"
| | ``````
| Wraps: (3) context canceled
| Error types: (1) errors.Unclassified (2) *hintdetail.withDetail (3) *errors.errorString
Wraps: (5) context canceled
Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) *secondary.withSecondaryError (5) *errors.errorString
monitor.go:127,restore.go:453,test_runner.go:875: monitor failure: monitor task failed: dial tcp 35.229.83.139:26257: connect: connection refused
(1) attached stack trace
-- stack trace:
| main.(*monitorImpl).WaitE
| main/pkg/cmd/roachtest/monitor.go:115
| main.(*monitorImpl).Wait
| main/pkg/cmd/roachtest/monitor.go:123
| github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerRestore.func1
| github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/restore.go:453
| [...repeated from below...]
Wraps: (2) monitor failure
Wraps: (3) attached stack trace
-- stack trace:
| main.(*monitorImpl).wait.func2
| main/pkg/cmd/roachtest/monitor.go:171
| runtime.goexit
| GOROOT/src/runtime/asm_amd64.s:1581
Wraps: (4) monitor task failed
Wraps: (5) dial tcp 35.229.83.139:26257
Wraps: (6) connect
Wraps: (7) connection refused
Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *net.OpError (6) *os.SyscallError (7) syscall.Errno
This test on roachdash | Improve this report!
Jira issue: CRDB-15827
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
C-test-failureBroken test (automatically or manually discovered).Broken test (automatically or manually discovered).O-roachtestO-robotOriginated from a bot.Originated from a bot.S-3Medium-low impact: incurs increased costs for some users (incl lower avail, recoverable bad data)Medium-low impact: incurs increased costs for some users (incl lower avail, recoverable bad data)branch-masterFailures and bugs on the master branch.Failures and bugs on the master branch.