Skip to content

ccl/backupccl: TestBackupRestoreMultiNodeLocal failed #95808

@cockroach-teamcity

Description

@cockroach-teamcity

ccl/backupccl.TestBackupRestoreMultiNodeLocal failed with artifacts on master @ 6eabc2f348710f4146ff984bc346cd8cbe96f83b:

      github.com/cockroachdb/cockroach/pkg/ccl/backupccl/split_and_scatter_processor.go:117 +0xee
  github.com/cockroachdb/cockroach/pkg/ccl/backupccl.(*dbSplitAndScatterer).scatter()
      <autogenerated>:1 +0x10b
  github.com/cockroachdb/cockroach/pkg/ccl/backupccl.runGenerativeSplitAndScatter.func3()
      github.com/cockroachdb/cockroach/pkg/ccl/backupccl/generative_split_and_scatter_processor.go:306 +0x2ce
  github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.GoCtx.func1()
      github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:168 +0x4c
  golang.org/x/sync/errgroup.(*Group).Go.func1()
      golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:75 +0x86

Previous write at 0x00c0027c5ba8 by goroutine 37612:
  github.com/cockroachdb/cockroach/pkg/ccl/backupccl.(*KeyRewriter).RewriteKey()
      github.com/cockroachdb/cockroach/pkg/ccl/backupccl/key_rewriter.go:250 +0x1d5
  github.com/cockroachdb/cockroach/pkg/ccl/backupccl.rewriteBackupSpanKey()
      github.com/cockroachdb/cockroach/pkg/ccl/backupccl/restore_job.go:111 +0xf4
  github.com/cockroachdb/cockroach/pkg/ccl/backupccl.dbSplitAndScatterer.split()
      github.com/cockroachdb/cockroach/pkg/ccl/backupccl/split_and_scatter_processor.go:89 +0x179
  github.com/cockroachdb/cockroach/pkg/ccl/backupccl.(*dbSplitAndScatterer).split()
      <autogenerated>:1 +0x104
  github.com/cockroachdb/cockroach/pkg/ccl/backupccl.runGenerativeSplitAndScatter.func3()
      github.com/cockroachdb/cockroach/pkg/ccl/backupccl/generative_split_and_scatter_processor.go:302 +0x23a
  github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.GoCtx.func1()
      github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:168 +0x4c
  golang.org/x/sync/errgroup.(*Group).Go.func1()
      golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:75 +0x86

Goroutine 37611 (running) created at:
  golang.org/x/sync/errgroup.(*Group).Go()
      golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:72 +0x12e
  github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.GoCtx()
      github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:167 +0x109
  github.com/cockroachdb/cockroach/pkg/ccl/backupccl.runGenerativeSplitAndScatter()
      github.com/cockroachdb/cockroach/pkg/ccl/backupccl/generative_split_and_scatter_processor.go:294 +0x52c
  github.com/cockroachdb/cockroach/pkg/ccl/backupccl.(*generativeSplitAndScatterProcessor).Start.func2()
      github.com/cockroachdb/cockroach/pkg/ccl/backupccl/generative_split_and_scatter_processor.go:127 +0x108
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6

Goroutine 37612 (running) created at:
  golang.org/x/sync/errgroup.(*Group).Go()
      golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:72 +0x12e
  github.com/cockroachdb/cockroach/pkg/util/ctxgroup.Group.GoCtx()
      github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:167 +0x109
  github.com/cockroachdb/cockroach/pkg/ccl/backupccl.runGenerativeSplitAndScatter()
      github.com/cockroachdb/cockroach/pkg/ccl/backupccl/generative_split_and_scatter_processor.go:294 +0x52c
  github.com/cockroachdb/cockroach/pkg/ccl/backupccl.(*generativeSplitAndScatterProcessor).Start.func2()
      github.com/cockroachdb/cockroach/pkg/ccl/backupccl/generative_split_and_scatter_processor.go:127 +0x108
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x1f6
==================

Parameters: TAGS=bazel,gss,race

Help

See also: How To Investigate a Go Test Failure (internal)

/cc @cockroachdb/disaster-recovery

This test on roachdash | Improve this report!

Jira issue: CRDB-23753

Epic CRDB-21942

Metadata

Metadata

Assignees

Labels

C-test-failureBroken test (automatically or manually discovered).O-robotOriginated from a bot.T-disaster-recoverybranch-masterFailures and bugs on the master branch.release-blockerIndicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked.

Type

No type

Projects

Relationships

None yet

Development

No branches or pull requests

Issue actions