Skip to content

ccl/importccl: TestImportIntoCSV failed under stress #41941

@cockroach-teamcity

Description

@cockroach-teamcity

SHA: https://github.com/cockroachdb/cockroach/commits/20ae612be5daed4ebad924470b80f4fe122029b0

Parameters:

TAGS=
GOFLAGS=-race -parallel=2

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=TestImportIntoCSV PKG=github.com/cockroachdb/cockroach/pkg/ccl/importccl TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1559063&tab=buildLog

I191026 06:49:25.497651 111593 util/stop/stopper.go:542  quiescing; tasks left:
2      [async] closedts-subscription
1      [async] storage.IntentResolver: cleanup txn records
1      [async] stats.Refresher: maybeRefreshStats
1      [async] closedts-rangefeed-subscriber
W191026 06:49:25.498470 39227 storage/raft_transport.go:637  [n1] while processing outgoing Raft queue to node 3: rpc error: code = Canceled desc = grpc: the client connection is closing:
W191026 06:49:25.499632 39257 storage/raft_transport.go:637  [n3] while processing outgoing Raft queue to node 1: rpc error: code = Unavailable desc = transport is closing:
I191026 06:49:25.500903 111593 util/stop/stopper.go:542  quiescing; tasks left:
2      [async] closedts-subscription
1      [async] stats.Refresher: maybeRefreshStats
1      [async] closedts-rangefeed-subscriber
W191026 06:49:25.502053 38809 storage/raft_transport.go:637  [n2] while processing outgoing Raft queue to node 1: rpc error: code = Unavailable desc = transport is closing:
W191026 06:49:25.504738 72229 storage/raft_transport.go:637  [n2] while processing outgoing Raft queue to node 3: EOF:
I191026 06:49:25.505052 111594 util/stop/stopper.go:542  quiescing; tasks left:
2      [async] closedts-subscription
1      [async] closedts-rangefeed-subscriber
W191026 06:49:25.506439 68622 storage/raft_transport.go:637  [n3] while processing outgoing Raft queue to node 2: EOF:
I191026 06:49:25.506696 111595 util/stop/stopper.go:542  quiescing; tasks left:
2      [async] closedts-subscription
1      [async] closedts-rangefeed-subscriber
W191026 06:49:25.507010 39173 storage/raft_transport.go:637  [n1] while processing outgoing Raft queue to node 2: rpc error: code = Canceled desc = grpc: the client connection is closing:
W191026 06:49:25.507501 68706 storage/raft_transport.go:637  [n2] while processing outgoing Raft queue to node 3: rpc error: code = Unavailable desc = transport is closing:
W191026 06:49:25.509675 72189 storage/raft_transport.go:637  [n3] while processing outgoing Raft queue to node 2: rpc error: code = Unavailable desc = transport is closing:
W191026 06:49:25.510421 39187 storage/raft_transport.go:637  [n3] while processing outgoing Raft queue to node 1: rpc error: code = Unavailable desc = transport is closing:
W191026 06:49:25.510564 38810 storage/raft_transport.go:637  [n2] while processing outgoing Raft queue to node 1: rpc error: code = Canceled desc = grpc: the client connection is closing:
I191026 06:49:25.513065 111593 util/stop/stopper.go:542  quiescing; tasks left:
2      [async] closedts-subscription
1      [async] closedts-rangefeed-subscriber
I191026 06:49:25.514154 111593 util/stop/stopper.go:542  quiescing; tasks left:
2      [async] closedts-subscription
I191026 06:49:25.514250 111594 util/stop/stopper.go:542  quiescing; tasks left:
2      [async] closedts-subscription
I191026 06:49:25.514630 111594 util/stop/stopper.go:542  quiescing; tasks left:
1      [async] closedts-subscription
I191026 06:49:25.514644 111593 util/stop/stopper.go:542  quiescing; tasks left:
1      [async] closedts-subscription
I191026 06:49:25.514775 111595 util/stop/stopper.go:542  quiescing; tasks left:
1      [async] closedts-subscription
I191026 06:49:25.538684 111638 rpc/nodedialer/nodedialer.go:160  [ct-client] unable to connect to n2: failed to connect to n2 at 127.0.0.1:35133: context canceled
E191026 06:49:25.539077 111475 vendor/google.golang.org/grpc/pickfirst.go:61  pickfirstBalancer: failed to NewSubConn: rpc error: code = Canceled desc = grpc: the client connection is closing
I191026 06:49:25.539186 111639 rpc/nodedialer/nodedialer.go:160  [ct-client] unable to connect to n1: failed to connect to n1 at 127.0.0.1:40503: context canceled
    --- FAIL: TestImportIntoCSV/import-into-invalidate-constraints (1.84s)
        import_stmt_test.go:2235: error executing 'DROP TABLE t': pq: job with ID 498080694234120193 does not exist
        panic.go:406: error executing 'DROP TABLE ref': pq: internal error: missing fk forward reference "fk_ref" to "ref" from "t"

Metadata

Metadata

Assignees

Labels

C-test-failureBroken test (automatically or manually discovered).O-robotOriginated from a bot.branch-masterFailures and bugs on the master branch.

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions