Skip to content

roachtest: kv/contention/nodes=4 failed #39190

@cockroach-teamcity

Description

@cockroach-teamcity

SHA: https://github.com/cockroachdb/cockroach/commits/92fef12128c997233d985d1c19e11faac005073f

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=kv/contention/nodes=4 PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1413388&tab=buildLog

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20190731-1413388/kv/contention/nodes=4/run_1
	cluster.go:1726,kv.go:197,cluster.go:2069,errgroup.go:57: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-1564553448-32-n5cpu4:5 -- ./workload run kv --init --secondary-index --duration=1h0m0s --cycle-length=512 --concurrency=128 --batch=4 --splits=4 {pgurl:1-4} returned:
		stderr:
		
		stdout:
		 write
		     58s        0          802.6          306.2     13.6   1342.2   9663.7  20401.1 write
		     59s        0          464.1          308.9      8.9    570.4   1342.2  12884.9 write
		    1m0s        0          164.0          306.5      6.3   1476.4   1811.9  36507.2 write
		_elapsed___errors__ops/sec(inst)___ops/sec(cum)__p50(ms)__p95(ms)__p99(ms)_pMax(ms)
		    1m1s        0           76.0          302.7      7.9   3087.0  15032.4  34359.7 write
		    1m2s        0          172.0          300.6      7.3   2550.1   3489.7  45097.2 write
		    1m3s        0          383.9          301.9      7.9   3087.0   4563.4  60129.5 write
		    1m4s        0          208.1          300.5      9.4   3892.3   6442.5  18253.6 write
		    1m5s        0          535.8          304.1      7.9   2013.3   3489.7   6174.0 write
		    1m6s        0          152.0          301.8      6.6   2281.7   6174.0   7516.2 write
		    1m7s        0           68.0          298.3      7.3   2415.9   5368.7  20401.1 write
		Error: EOF
		Error:  exit status 1
		: exit status 1
	cluster.go:2090,kv.go:207,test_runner.go:691: unexpected node event: 1: dead

Metadata

Metadata

Assignees

Labels

C-test-failureBroken test (automatically or manually discovered).O-roachtestO-robotOriginated from a bot.

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions