Skip to content

roachtest: kv/splits/nodes=3/quiesce=true failed #31580

@cockroach-teamcity

Description

@cockroach-teamcity

SHA: https://github.com/cockroachdb/cockroach/commits/670c7d3df74e0efbc633ceac8e97fada3b1063b2

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stressrace instead of stress and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
make stress TESTS=kv/splits/nodes=3/quiesce=true PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-stderr=false -maxtime 20m -timeout 10m'

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=972105&tab=buildLog

The test failed on release-2.1:
	test.go:606,cluster.go:1098,kv.go:192,cluster.go:1420,errgroup.go:58: /home/agent/work/.go/bin/roachprod run teamcity-972105-kv-splits-nodes-3-quiesce-true:4 -- ./workload run kv --init --max-ops=1 --concurrency=192 --splits=500000 {pgurl:1-3} returned:
		stderr:
		
		stdout:
		686712320) TO (4262572861686712320): dial tcp 10.128.0.5:26257: connect: connection refused
		W181018 06:35:29.967115 60 workload/workload.go:434  ALTER TABLE kv SCATTER FROM (-1732680758737946624) TO (-1732680758737946624): dial tcp 10.128.0.5:26257: connect: connection refused
		W181018 06:35:29.968848 482 workload/workload.go:434  ALTER TABLE kv SCATTER FROM (-1736812821146333184) TO (-1736812821146333184): dial tcp 10.128.0.5:26257: connect: connection refused
		W181018 06:35:29.969087 360 workload/workload.go:434  ALTER TABLE kv SCATTER FROM (-1736554567245808640) TO (-1736554567245808640): dial tcp 10.128.0.5:26257: connect: connection refused
		W181018 06:35:29.969130 295 workload/workload.go:434  ALTER TABLE kv SCATTER FROM (4301975028223821824) TO (4301975028223821824): dial tcp 10.128.0.5:26257: connect: connection refused
		W181018 06:35:29.969351 453 workload/workload.go:434  ALTER TABLE kv SCATTER FROM (-8554088606939305984) TO (-8554088606939305984): dial tcp 10.128.0.5:26257: connect: connection refused
		: signal: killed
	test.go:606,cluster.go:1441,kv.go:195: unexpected node event: 1: dead

Metadata

Metadata

Assignees

No one assigned

    Labels

    C-test-failureBroken test (automatically or manually discovered).O-robotOriginated from a bot.

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions