Skip to content

ccl/partitionccl: TestRepartitioning failed under stress #37883

@cockroach-teamcity

Description

@cockroach-teamcity

SHA: https://github.com/cockroachdb/cockroach/commits/c280de40c2bcab93c41fe82bef8353a5ecd95ac4

Parameters:

TAGS=
GOFLAGS=-parallel=4

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=TestRepartitioning PKG=github.com/cockroachdb/cockroach/pkg/ccl/partitionccl TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1312022&tab=buildLog

              [n1,client=127.0.0.1:55340,user=root] planning starts: SELECT
              [n1,client=127.0.0.1:55340,user=root] generating optimizer plan
              [n1,client=127.0.0.1:55340,user=root] added table 'data.public."single col range partitioning - MAXVALUE"' to table collection
              [n1,client=127.0.0.1:55340,user=root] query cache hit
              [n1,client=127.0.0.1:55340,user=root] planning ends
              [n1,client=127.0.0.1:55340,user=root] checking distributability
              [n1,client=127.0.0.1:55340,user=root] will distribute plan: true
              [n1,client=127.0.0.1:55340,user=root] execution starts: distributed engine
               === SPAN START: consuming rows ===
              [n1,client=127.0.0.1:55340,user=root] creating DistSQL plan with isLocal=false
              [n1,client=127.0.0.1:55340,user=root] querying next range at /Table/76/1/6
              [n1,client=127.0.0.1:55340,user=root] running DistSQL plan
               === SPAN START: flow ===
              [n1,client=127.0.0.1:55340,user=root] starting (0 processors, 0 startables)
               === SPAN START: table reader ===
            cockroach.processorid: 0
            cockroach.stat.tablereader.bytes.read: 0 B
            cockroach.stat.tablereader.input.rows: 0
            cockroach.stat.tablereader.stalltime: 0s
              [n1,client=127.0.0.1:55340,user=root] starting scan with limitBatches true
              [n1,client=127.0.0.1:55340,user=root] Scan /Table/76/{1/6-2}
               === SPAN START: txn coordinator send ===
               === SPAN START: dist sender send ===
              [n1,client=127.0.0.1:55340,user=root,txn=e7753557] querying next range at /Table/76/1/6
              [n1,client=127.0.0.1:55340,user=root,txn=e7753557] r91: sending batch 1 Scan to (n1,s1):1
              [n1,client=127.0.0.1:55340,user=root,txn=e7753557] sending request to local client
               === SPAN START: /cockroach.roachpb.Internal/Batch ===
              [n1] 1 Scan
              [n1,s1] executing 1 requests
              [n1,s1,r91/1:/Table/76/{1/5-2}] read-only path
              [n1,s1,r91/1:/Table/76/{1/5-2}] read has no clock uncertainty
              [n1,s1,r91/1:/Table/76/{1/5-2}] acquire latches
              [n1,s1,r91/1:/Table/76/{1/5-2}] waited 4.819µs to acquire latches
              [n1,s1,r91/1:/Table/76/{1/5-2}] waiting for read lock
              [n1,s1,r91/1:/Table/76/{1/5-2}] read completed
               === SPAN START: count rows ===
            cockroach.processorid: 1
            cockroach.stat.aggregator.input.rows: 0
            cockroach.stat.aggregator.mem.max: 0 B
            cockroach.stat.aggregator.stalltime: 37µs
              [n1,client=127.0.0.1:55340,user=root] execution ends
              [n1,client=127.0.0.1:55340,user=root] rows affected: 1
              [n1,client=127.0.0.1:55340,user=root] AutoCommit. err: <nil>
              [n1,client=127.0.0.1:55340,user=root] releasing 1 tables
               === SPAN START: exec cmd: exec stmt ===
              [n1,client=127.0.0.1:55340,user=root] [NoTxn pos:7134] executing ExecStmt: SET TRACING = off
              [n1,client=127.0.0.1:55340,user=root] executing: SET TRACING = off in state: NoTxn
            goroutine 457667 [running]:
            runtime/debug.Stack(0xa7a358200, 0xc003937050, 0x3876e80)
            	/usr/local/go/src/runtime/debug/stack.go:24 +0xa7
            github.com/cockroachdb/cockroach/pkg/testutils.SucceedsSoon(0x38e26a0, 0xc0014b4500, 0xc003937020)
            	/go/src/github.com/cockroachdb/cockroach/pkg/testutils/soon.go:49 +0x103
            github.com/cockroachdb/cockroach/pkg/ccl/partitionccl.TestRepartitioning.func1(0xc0014b4500)
            	/go/src/github.com/cockroachdb/cockroach/pkg/ccl/partitionccl/partition_test.go:1356 +0xabc
            testing.tRunner(0xc0014b4500, 0xc005a12120)
            	/usr/local/go/src/testing/testing.go:827 +0xbf
            created by testing.(*T).Run
            	/usr/local/go/src/testing/testing.go:878 +0x35c

Metadata

Metadata

Assignees

Labels

C-test-failureBroken test (automatically or manually discovered).O-robotOriginated from a bot.

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions