Skip to content

roachtest: cdc/tpcc-1000/rangefeed=true failed #46290

@cockroach-teamcity

Description

@cockroach-teamcity

(roachtest).cdc/tpcc-1000/rangefeed=true failed on provisional_202003181957_v20.1.0-beta.3@37f2a6964760b5d72bef655342628e31601b8978:

		     1586.0s        0           21.0           21.0     48.2     58.7     62.9     62.9 stockLevel
		     1587.0s        0           18.0           21.0     75.5    176.2    192.9    192.9 delivery
		     1587.0s        0          195.6          208.7     44.0    142.6    167.8    167.8 newOrder
		     1587.0s        0           27.0           21.0      9.4     37.7     37.7     37.7 orderStatus
		     1587.0s        0          191.6          210.1     46.1     83.9     96.5    109.1 payment
		     1587.0s        0           18.0           20.9     60.8    121.6    125.8    125.8 stockLevel
		     1588.0s        0            2.0           21.0     83.9     92.3     92.3     92.3 delivery
		     1588.0s        0           46.1          208.6     58.7    838.9  10737.4  10737.4 newOrder
		     1588.0s        0            7.0           21.0     12.1    302.0    302.0    302.0 orderStatus
		     1588.0s        0           39.1          210.0     33.6     48.2     96.5     96.5 payment
		     1588.0s        0            9.0           20.9     44.0     83.9     83.9     83.9 stockLevel
		    _elapsed___errors__ops/sec(inst)___ops/sec(cum)__p50(ms)__p95(ms)__p99(ms)_pMax(ms)
		     1589.0s      310            0.0           21.0      0.0      0.0      0.0      0.0 delivery
		     1589.0s      310            0.0          208.5      0.0      0.0      0.0      0.0 newOrder
		     1589.0s      310            1.0           20.9      7.1      7.1      7.1      7.1 orderStatus
		     1589.0s      310            0.0          209.9      0.0      0.0      0.0      0.0 payment
		     1589.0s      310            2.0           20.9     27.3     35.7     35.7     35.7 stockLevel
		     1590.0s      474            3.0           21.0     39.8     52.4     52.4     52.4 delivery
		     1590.0s      474            0.0          208.4      0.0      0.0      0.0      0.0 newOrder
		     1590.0s      474            0.0           20.9      0.0      0.0      0.0      0.0 orderStatus
		     1590.0s      474            0.0          209.7      0.0      0.0      0.0      0.0 payment
		     1590.0s      474            3.0           20.9     25.2     31.5     31.5     31.5 stockLevel
		     1591.0s      652            1.0           21.0     52.4     52.4     52.4     52.4 delivery
		     1591.0s      652            0.0          208.2      0.0      0.0      0.0      0.0 newOrder
		     1591.0s      652            1.0           20.9      6.3      6.3      6.3      6.3 orderStatus
		     1591.0s      652            0.0          209.6      0.0      0.0      0.0      0.0 payment
		     1591.0s      652            2.0           20.9     35.7     41.9     41.9     41.9 stockLevel:
		  - context canceled

	cluster.go:2368,cdc.go:224,cdc.go:521,test_runner.go:753: error with attached stack trace:
		    main.(*monitor).WaitE
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2356
		    main.(*monitor).Wait
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2364
		    main.cdcBasicTest
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cdc.go:224
		    main.registerCDC.func1
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cdc.go:521
		    main.(*testRunner).runTest.func2
		    	/home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:753
		    runtime.goexit
		    	/usr/local/go/src/runtime/asm_amd64.s:1357
		  - monitor failure:
		  - unexpected node event: 3: dead

	cluster.go:1410,context.go:135,cluster.go:1399,test_runner.go:825: dead node detection: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod monitor teamcity-1816942-1584592838-25-n4cpu16 --oneshot --ignore-empty-nodes: exit status 1 4: skipped
		3: dead
		1: 4483
		2: 4388
		Error:  3: dead

More

Artifacts: /cdc/tpcc-1000/rangefeed=true
Related:

See this test on roachdash
powered by pkg/cmd/internal/issues

Metadata

Metadata

Assignees

Labels

C-test-failureBroken test (automatically or manually discovered).O-roachtestO-robotOriginated from a bot.release-blockerIndicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked.

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions