Skip to content

teamcity: failed test: TestSnapshotAfterTruncationWithUncommittedTail #37085

@cockroach-teamcity

Description

@cockroach-teamcity

The following tests appear to have failed on master (test): TestSnapshotAfterTruncationWithUncommittedTail

You may want to check for open issues.

#1259277:

TestSnapshotAfterTruncationWithUncommittedTail
...16:49:08.439731 269204 storage/store.go:1530  [s1,r1/1:/M{in-ax}] could not gossip first range descriptor: [NotLeaseHolderError] r1: replica (n1,s1):1 not lease holder; lease holder unknown
I190424 16:49:08.439798 417133 internal/client/txn.go:619  async rollback failed: failed to send RPC: sending to all 3 replicas failed; last error: (err: node unavailable; try another peer) <nil>
I190424 16:49:08.439834 408751 storage/client_test.go:1332  [txn=db1990a1] test clock advanced to: 516.600000697,0
I190424 16:49:08.439854 417810 util/stop/stopper.go:546  quiescing; tasks left:
4      mtc send
I190424 16:49:08.439946 408751 internal/client/txn.go:619  async rollback failed: failed to send RPC: sending to all 3 replicas failed; last error: (err: node unavailable; try another peer) <nil>
I190424 16:49:08.440050 409996 storage/client_test.go:1332  [txn=a9160843] test clock advanced to: 518.400000699,0
I190424 16:49:08.440112 416866 internal/client/txn.go:619  async rollback failed: failed to send RPC: sending to all 3 replicas failed; last error: (err: node unavailable; try another peer) <nil>
I190424 16:49:08.440146 417810 util/stop/stopper.go:546  quiescing; tasks left:
2      mtc send
I190424 16:49:08.440184 409996 internal/client/txn.go:619  async rollback failed: failed to send RPC: sending to all 3 replicas failed; last error: (err: node unavailable; try another peer) <nil>
I190424 16:49:08.440270 412690 internal/client/txn.go:619  async rollback failed: failed to send RPC: sending to all 3 replicas failed; last error: (err: node unavailable; try another peer) <nil>
I190424 16:49:08.440302 417810 util/stop/stopper.go:546  quiescing; tasks left:
1      mtc send
I190424 16:49:08.440327 269350 storage/client_test.go:1332  [hb,txn=14730dc2] test clock advanced to: 520.200000701,0
W190424 16:49:08.440505 269350 internal/client/txn.go:510  [hb] failure aborting transaction: node unavailable; try another peer; abort caused by: failed to send RPC: sending to all 3 replicas failed; last error: (err: node unavailable; try another peer) <nil>
W190424 16:49:08.440546 269350 storage/node_liveness.go:463  [hb] failed node liveness heartbeat: failed to send RPC: sending to all 3 replicas failed; last error: (err: node unavailable; try another peer) <nil>
I190424 16:49:08.442240 269227 storage/node_liveness.go:775  [hb] retrying liveness update after storage.errRetryLiveness: result is ambiguous (context done during DistSender.Send: context canceled)
W190424 16:49:08.442279 269227 storage/node_liveness.go:463  [hb] failed node liveness heartbeat: context canceled
I190424 16:49:08.442511 417925 internal/client/txn.go:619  async rollback failed: node unavailable; try another peer
W190424 16:49:08.443286 269620 gossip/gossip.go:1496  [n3] no incoming or outgoing connections
W190424 16:49:08.443437 270326 storage/raft_transport.go:583  while processing outgoing Raft queue to node 3: rpc error: code = Unavailable desc = transport is closing:
W190424 16:49:08.443480 269349 gossip/gossip.go:1496  [n2] no incoming or outgoing connections
    client_raft_test.go:1013: condition failed to evaluate within 45s: expected at least 1 snapshot to catch the partitioned replica up
        goroutine 269065 [running]:
        runtime/debug.Stack(0xa7a358200, 0xc001fac060, 0x3520be0)
        	/usr/local/go/src/runtime/debug/stack.go:24 +0xa7
        github.com/cockroachdb/cockroach/pkg/testutils.SucceedsSoon(0x35865e0, 0xc00124fc00, 0xc0037c33e0)
        	/go/src/github.com/cockroachdb/cockroach/pkg/testutils/soon.go:49 +0x103
        github.com/cockroachdb/cockroach/pkg/storage_test.TestSnapshotAfterTruncationWithUncommittedTail(0xc00124fc00)
        	/go/src/github.com/cockroachdb/cockroach/pkg/storage/client_raft_test.go:1013 +0xed4
        testing.tRunner(0xc00124fc00, 0x2f34e78)
        	/usr/local/go/src/testing/testing.go:827 +0xbf
        created by testing.(*T).Run
        	/usr/local/go/src/testing/testing.go:878 +0x35c




Please assign, take a look and update the issue accordingly.

Metadata

Metadata

Assignees

Labels

C-test-failureBroken test (automatically or manually discovered).O-robotOriginated from a bot.

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions