Skip to content

sql: TestBackfillWithProtectedTS failed #142117

@cockroach-teamcity

Description

@cockroach-teamcity

sql.TestBackfillWithProtectedTS failed on release-24.1 @ eb84e8e970524a3b033f81c6a486614dbc19f537:

=== RUN   TestBackfillWithProtectedTS
    test_log_scope.go:165: test logs captured to: outputs.zip/logTestBackfillWithProtectedTS515945980
    test_log_scope.go:76: use -show-logs to present logs inline
    test_server_shim.go:139: cluster virtualization disabled in global scope due to issue: #76378 (expected label: C-bug)
    conditional_wrap.go:185: 
        pkg/sql_test/pkg/sql/backfill_protected_timestamp_test.go:337: (TestBackfillWithProtectedTS.func5)
        	NOTICE: .GetStores() called via implicit interface StorageLayerInterface;
        HINT: consider using .StorageLayer().GetStores() instead.
    conditional_wrap.go:185: 
        pkg/sql_test/pkg/sql/backfill_protected_timestamp_test.go:310: (TestBackfillWithProtectedTS.func4)
        	NOTICE: .Codec() called via implicit interface ApplicationLayerInterface;
        HINT: consider using .ApplicationLayer().Codec() instead.
    conditional_wrap.go:189: TIP: consider replacing the test server initialization from:
            ts, ... := serverutils.StartServer(t, ...)
            defer ts.Stopper().Stop(...)
        to:
            srv, ... := serverutils.StartServer(t, ...)
            defer srv.Stopper().Stop(...)
            ts := srv.ApplicationLayer()
        
        See also: https://go.crdb.dev/p/testserver-and-cluster-virtualization
    backfill_protected_timestamp_test.go:548: -- test log scope end --
test logs left over in: outputs.zip/logTestBackfillWithProtectedTS515945980
--- FAIL: TestBackfillWithProtectedTS (121.46s)
=== RUN   TestBackfillWithProtectedTS/create_index
    backfill_protected_timestamp_test.go:502: 2025-02-28T08:10:40Z running backfill with PTS not setup early enough
    backfill_protected_timestamp_test.go:437: 2025-02-28T08:10:40Z i=0 begin running operations in the middle of backfill
    backfill_protected_timestamp_test.go:442: 2025-02-28T08:10:47Z i=0 finished running operations in the middle of backfill. retErr: failed to DELETE; deleted 1000 so far: pq: batch timestamp 1740730240.394233639,0 must be after replica GC threshold 1740730242.216197918,0 (r75: /Table/107{-/2})
    backfill_protected_timestamp_test.go:500: 2025-02-28T08:11:32Z backfill goroutine finished. retErr: context canceled
    backfill_protected_timestamp_test.go:537: 
        	Error Trace:	github.com/cockroachdb/cockroach/pkg/sql_test/pkg/sql/backfill_protected_timestamp_test.go:537
        	Error:      	Received unexpected error:
        	            	failed to DELETE; deleted 1000 so far: pq: batch timestamp 1740730240.394233639,0 must be after replica GC threshold 1740730242.216197918,0 (r75: /Table/107{-/2})
        	            	(1) attached stack trace
        	            	  -- stack trace:
        	            	  | github.com/cockroachdb/cockroach/pkg/sql_test.TestBackfillWithProtectedTS.func7.2.1
        	            	  | 	github.com/cockroachdb/cockroach/pkg/sql_test/pkg/sql/backfill_protected_timestamp_test.go:457
        	            	  | github.com/cockroachdb/cockroach/pkg/sql_test.TestBackfillWithProtectedTS.func7.2
        	            	  | 	github.com/cockroachdb/cockroach/pkg/sql_test/pkg/sql/backfill_protected_timestamp_test.go:490
        	            	  | github.com/cockroachdb/cockroach/pkg/sql_test.TestBackfillWithProtectedTS.func7.Group.GoCtx.4
        	            	  | 	github.com/cockroachdb/cockroach/pkg/util/ctxgroup/ctxgroup.go:163
        	            	  | golang.org/x/sync/errgroup.(*Group).Go.func1
        	            	  | 	golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:78
        	            	  | runtime.goexit
        	            	  | 	src/runtime/asm_amd64.s:1695
        	            	Wraps: (2) failed to DELETE; deleted 1000 so far
        	            	Wraps: (3) pq: batch timestamp 1740730240.394233639,0 must be after replica GC threshold 1740730242.216197918,0 (r75: /Table/107{-/2})
        	            	Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *pq.Error
        	Test:       	TestBackfillWithProtectedTS/create_index
    --- FAIL: TestBackfillWithProtectedTS/create_index (55.62s)

Parameters:

  • attempt=1
  • run=2
  • shard=5
Help

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

/cc @cockroachdb/sql-foundations

This test on roachdash | Improve this report!

Jira issue: CRDB-48171

Metadata

Metadata

Assignees

Labels

C-test-failureBroken test (automatically or manually discovered).O-robotOriginated from a bot.P-2Issues/test failures with a fix SLA of 3 monthsT-sql-foundationsSQL Foundations Team (formerly SQL Schema + SQL Sessions)branch-release-24.1Used to mark GA and release blockers, technical advisories, and bugs for 24.1

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions