-
Notifications
You must be signed in to change notification settings - Fork 4.1k
roachtest: kv/contention/nodes=4 failed #39190
Copy link
Copy link
Closed
Labels
C-test-failureBroken test (automatically or manually discovered).Broken test (automatically or manually discovered).O-roachtestO-robotOriginated from a bot.Originated from a bot.
Milestone
Description
SHA: https://github.com/cockroachdb/cockroach/commits/92fef12128c997233d985d1c19e11faac005073f
Parameters:
To repro, try:
# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=kv/contention/nodes=4 PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log
Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1413388&tab=buildLog
The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20190731-1413388/kv/contention/nodes=4/run_1
cluster.go:1726,kv.go:197,cluster.go:2069,errgroup.go:57: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-1564553448-32-n5cpu4:5 -- ./workload run kv --init --secondary-index --duration=1h0m0s --cycle-length=512 --concurrency=128 --batch=4 --splits=4 {pgurl:1-4} returned:
stderr:
stdout:
write
58s 0 802.6 306.2 13.6 1342.2 9663.7 20401.1 write
59s 0 464.1 308.9 8.9 570.4 1342.2 12884.9 write
1m0s 0 164.0 306.5 6.3 1476.4 1811.9 36507.2 write
_elapsed___errors__ops/sec(inst)___ops/sec(cum)__p50(ms)__p95(ms)__p99(ms)_pMax(ms)
1m1s 0 76.0 302.7 7.9 3087.0 15032.4 34359.7 write
1m2s 0 172.0 300.6 7.3 2550.1 3489.7 45097.2 write
1m3s 0 383.9 301.9 7.9 3087.0 4563.4 60129.5 write
1m4s 0 208.1 300.5 9.4 3892.3 6442.5 18253.6 write
1m5s 0 535.8 304.1 7.9 2013.3 3489.7 6174.0 write
1m6s 0 152.0 301.8 6.6 2281.7 6174.0 7516.2 write
1m7s 0 68.0 298.3 7.3 2415.9 5368.7 20401.1 write
Error: EOF
Error: exit status 1
: exit status 1
cluster.go:2090,kv.go:207,test_runner.go:691: unexpected node event: 1: dead
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
C-test-failureBroken test (automatically or manually discovered).Broken test (automatically or manually discovered).O-roachtestO-robotOriginated from a bot.Originated from a bot.