I210811 07:40:52.565877 5550 3@vendor/github.com/cockroachdb/pebble/event.go:577  [n3,pebble,s3] 3172  [JOB 286] compacted(elision-only) L6 [000413] (1.0 K) + L6 [] (0 B) -> L6 [] (0 B), in 0.0s, output rate 0 B/s
I210811 07:40:52.565991 5551 3@vendor/github.com/cockroachdb/pebble/event.go:605  [n3,pebble,s3] 3173  [JOB 286] sstable deleted 000413
I210811 07:40:52.566048 5549 3@vendor/github.com/cockroachdb/pebble/event.go:605  [n3,pebble,s3] 3174  [JOB 285] sstable deleted 000409
I210811 07:40:52.566084 5549 3@vendor/github.com/cockroachdb/pebble/event.go:605  [n3,pebble,s3] 3175  [JOB 285] sstable deleted 000410
I210811 07:40:52.566103 5549 3@vendor/github.com/cockroachdb/pebble/event.go:605  [n3,pebble,s3] 3176  [JOB 285] sstable deleted 000411
I210811 07:40:52.566123 5549 3@vendor/github.com/cockroachdb/pebble/event.go:605  [n3,pebble,s3] 3177  [JOB 285] sstable deleted 000412
I210811 07:40:52.566142 5549 3@vendor/github.com/cockroachdb/pebble/event.go:605  [n3,pebble,s3] 3178  [JOB 285] sstable deleted 000414
I210811 07:40:52.566160 5549 3@vendor/github.com/cockroachdb/pebble/event.go:605  [n3,pebble,s3] 3179  [JOB 285] sstable deleted 000417
I210811 07:40:52.567067 5634 kv/kvserver/raft_snapshot_queue.go:129  [n1,raftsnapshot,s1,r21/1:/Table/2{5-6}] 3180  skipping snapshot; replica is likely a LEARNER in the process of being added: (n3,s3):3LEARNER
I210811 07:40:52.567177 43 kv/kvserver/store_snapshot.go:1138  [n1,replicate,s1,r21/1:/Table/2{5-6}] 3181  streamed INITIAL snapshot 0e82cdca at applied index 19 to (n3,s3):3LEARNER in 0.00s @ 4.1 MiB/s: kv pairs: 12, log entries: 0, rate-limit: 8.0 MiB/s, queued: 0.00s
I210811 07:40:52.568636 5312 kv/kvserver/replica_raftstorage.go:824  [n3,s3,r21/3:{-}] 3182  applying snapshot of type INITIAL [id=0e82cdca index=19]
I210811 07:40:52.569134 5312 3@vendor/github.com/cockroachdb/pebble/event.go:601  [n3,pebble,s3] 3183  [JOB 287] ingesting: sstable created 000419
I210811 07:40:52.569198 5312 3@vendor/github.com/cockroachdb/pebble/event.go:601  [n3,pebble,s3] 3184  [JOB 287] ingesting: sstable created 000424
I210811 07:40:52.569237 5312 3@vendor/github.com/cockroachdb/pebble/event.go:601  [n3,pebble,s3] 3185  [JOB 287] ingesting: sstable created 000420
I210811 07:40:52.569263 5312 3@vendor/github.com/cockroachdb/pebble/event.go:601  [n3,pebble,s3] 3186  [JOB 287] ingesting: sstable created 000421
I210811 07:40:52.569288 5312 3@vendor/github.com/cockroachdb/pebble/event.go:601  [n3,pebble,s3] 3187  [JOB 287] ingesting: sstable created 000422
I210811 07:40:52.569310 5312 3@vendor/github.com/cockroachdb/pebble/event.go:601  [n3,pebble,s3] 3188  [JOB 287] ingesting: sstable created 000423
I210811 07:40:52.569379 5312 3@vendor/github.com/cockroachdb/pebble/event.go:617  [n3,pebble,s3] 3189  [JOB 288] WAL created 000425 (recycled 000395)
I210811 07:40:52.569578 5636 3@vendor/github.com/cockroachdb/pebble/event.go:585  [n3,pebble,s3] 3190  [JOB 289] flushing 1 memtable to L0
I210811 07:40:52.569635 5636 3@vendor/github.com/cockroachdb/pebble/event.go:601  [n3,pebble,s3] 3191  [JOB 289] flushing: sstable created 000426
I210811 07:40:52.569954 5636 3@vendor/github.com/cockroachdb/pebble/event.go:589  [n3,pebble,s3] 3192  [JOB 289] flushed 1 memtable to L0 [000426] (6.3 K), in 0.0s, output rate 19 M/s
I210811 07:40:52.570094 5637 3@vendor/github.com/cockroachdb/pebble/event.go:573  [n3,pebble,s3] 3193  [JOB 290] compacting(default) L0 [000426] (6.3 K) + L6 [000418] (239 K)
I210811 07:40:52.570518 5637 3@vendor/github.com/cockroachdb/pebble/event.go:601  [n3,pebble,s3] 3194  [JOB 290] compacting: sstable created 000427
I210811 07:40:52.573243 5312 3@vendor/github.com/cockroachdb/pebble/event.go:609  [n3,pebble,s3] 3195  [JOB 287] ingested L0:000419 (1.3 K), L0:000424 (1.2 K), L0:000420 (1.6 K), L0:000421 (1.0 K), L0:000422 (1.0 K), L6:000423 (1.0 K)
I210811 07:40:52.573728 5312 kv/kvserver/replica_raftstorage.go:845  [n3,s3,r21/3:/Table/2{5-6}] 3196  applied snapshot of type INITIAL [total=5msingestion=6@5msid=0e82cdca index=19]
I210811 07:40:52.574638 43 kv/kvserver/replica_command.go:2118  [n1,replicate,s1,r21/1:/Table/2{5-6}] 3197  change replicas (add [(n3,s3):3] remove []): existing descriptor r21:/Table/2{5-6} [(n1,s1):1, (n2,s2):2, (n3,s3):3LEARNER, next=4, gen=3]
I210811 07:40:52.578095 5530 3@vendor/github.com/cockroachdb/pebble/event.go:577  [n2,pebble,s2] 3198  [JOB 324] compacted(default) L0 [000419 000424 000420 000421 000422] (5.9 K) + L6 [000427] (226 K) -> L6 [000428] (226 K), in 0.0s, output rate 8.3 M/s
I210811 07:40:52.580196 43 kv/kvserver/replica_raft.go:277  [n1,s1,r21/1:/Table/2{5-6}] 3199  proposing SIMPLE(v3) [(n3,s3):3]: after=[(n1,s1):1 (n2,s2):2 (n3,s3):3] next=4
I210811 07:40:52.580783 5532 3@vendor/github.com/cockroachdb/pebble/event.go:573  [n2,pebble,s2] 3200  [JOB 325] compacting(elision-only) L6 [000423] (1.0 K) + L6 [] (0 B)
I210811 07:40:52.581029 5532 3@vendor/github.com/cockroachdb/pebble/event.go:577  [n2,pebble,s2] 3201  [JOB 325] compacted(elision-only) L6 [000423] (1.0 K) + L6 [] (0 B) -> L6 [] (0 B), in 0.0s, output rate 0 B/s
I210811 07:40:52.581183 5578 3@vendor/github.com/cockroachdb/pebble/event.go:605  [n2,pebble,s2] 3202  [JOB 325] sstable deleted 000423
I210811 07:40:52.582621 5531 3@vendor/github.com/cockroachdb/pebble/event.go:605  [n2,pebble,s2] 3203  [JOB 324] sstable deleted 000419
I210811 07:40:52.582740 5531 3@vendor/github.com/cockroachdb/pebble/event.go:605  [n2,pebble,s2] 3204  [JOB 324] sstable deleted 000420
I210811 07:40:52.582788 5531 3@vendor/github.com/cockroachdb/pebble/event.go:605  [n2,pebble,s2] 3205  [JOB 324] sstable deleted 000421
I210811 07:40:52.582810 5531 3@vendor/github.com/cockroachdb/pebble/event.go:605  [n2,pebble,s2] 3206  [JOB 324] sstable deleted 000422
I210811 07:40:52.582830 5531 3@vendor/github.com/cockroachdb/pebble/event.go:605  [n2,pebble,s2] 3207  [JOB 324] sstable deleted 000424
I210811 07:40:52.582848 5531 3@vendor/github.com/cockroachdb/pebble/event.go:605  [n2,pebble,s2] 3208  [JOB 324] sstable deleted 000427
I210811 07:40:52.591786 5637 3@vendor/github.com/cockroachdb/pebble/event.go:577  [n3,pebble,s3] 3209  [JOB 290] compacted(default) L0 [000426] (6.3 K) + L6 [000418] (239 K) -> L6 [000427] (242 K), in 0.0s, output rate 11 M/s
I210811 07:40:52.592139 5638 3@vendor/github.com/cockroachdb/pebble/event.go:605  [n3,pebble,s3] 3210  [JOB 290] sstable deleted 000418
I210811 07:40:52.592331 5638 3@vendor/github.com/cockroachdb/pebble/event.go:605  [n3,pebble,s3] 3211  [JOB 290] sstable deleted 000426
I210811 07:40:52.592567 5639 3@vendor/github.com/cockroachdb/pebble/event.go:573  [n3,pebble,s3] 3212  [JOB 292] compacting(default) L0 [000419 000424 000420 000421 000422] (6.1 K) + L6 [000427] (242 K)
I210811 07:40:52.593123 5639 3@vendor/github.com/cockroachdb/pebble/event.go:601  [n3,pebble,s3] 3213  [JOB 292] compacting: sstable created 000428
I210811 07:40:52.595052 43 testutils/testcluster/testcluster.go:1157  [-] 3214  WaitForFullReplication took: 3.019015885s
=== CONT  TestStreamIngestionFrontierProcessor
    stream_ingestion_frontier_processor_test.go:242: Leaked goroutine: goroutine 5737 [chan send]:
        github.com/cockroachdb/cockroach/pkg/ccl/streamingccl/streamingest.(*mockStreamClient).ConsumePartition.func1(0xc002e32780, 0xc002e32e40, 0xc00494dd00, 0x1, 0x1, 0x5938510, 0xc00428b900, 0xc005b94cc0, 0x44dc461, 0x12)
        	/go/src/github.com/cockroachdb/cockroach/pkg/ccl/streamingccl/streamingest/stream_ingestion_processor_test.go:95 +0x26d
        created by github.com/cockroachdb/cockroach/pkg/ccl/streamingccl/streamingest.(*mockStreamClient).ConsumePartition
        	/go/src/github.com/cockroachdb/cockroach/pkg/ccl/streamingccl/streamingest/stream_ingestion_processor_test.go:87 +0x15c
--- FAIL: TestStreamIngestionFrontierProcessor (8.97s)