roachtest: stability problems during tpcc-{5,10,20}k on {6,12,24} nodes #31409
Description
Describe the problem
Dead node with 9k underreplicated ranges when running tpcc
To Reproduce
Modified to use roachtest from 2 days ago:
Modified test to use partitioning and 6 nodes:
@@ -675,11 +675,12 @@ func registerTPCCBench(r *registry) {
// StoreDirVersion: "2.0-5",
},
{
- Nodes: 3,
+ Nodes: 6,
CPUs: 16,
- LoadWarehouses: 2000,
- EstimatedMax: 1300,
+ LoadWarehouses: 5000,
+ EstimatedMax: 3000,
+ LoadConfig: singlePartitionedLoadgen,
},Ran:
bin/roachtest bench '^tpccbench/nodes=6/cpu=16/partition$$' --wipe=false --user=andy
Expected behavior
No dead nodes
Additional data / screenshots
Environment:
- CockroachDB version 2.1 Beta 1008
Dead node logs:
cockroach.log