Skip to content

upgrade/upgrades: TestMigrationWithFailures failed #98564

@cockroach-teamcity

Description

@cockroach-teamcity

upgrade/upgrades.TestMigrationWithFailures failed with artifacts on master @ 0c6ccaf5c6fc8f94bb2a1e6132e44fe9e82bd9ed:

Fatal error:

panic: runtime error: invalid memory address or nil pointer dereference [recovered]
	panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x20 pc=0x3c7d7d7]

Stack:

goroutine 9644452 [running]:
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).recover(0x3?, {0x5bee6c8, 0xc0099ecf60})
	github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:229 +0x6a
panic({0x43065a0, 0x81feb50})
	GOROOT/src/runtime/panic.go:884 +0x212
github.com/cockroachdb/cockroach/pkg/server.(*refreshInstanceSessionListener).OnSessionDeleted.func1({0xc0032ee400, 0x0})
	github.com/cockroachdb/cockroach/pkg/server/server_sql.go:472 +0x117
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
	github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:470 +0x146
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx
	github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:461 +0x43b
Log preceding fatal error

    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/194b1b11adb2bb86a3c51c4924595952/logTestMigrationWithFailures_adding_columns1172456435
    test_log_scope.go:79: use -show-logs to present logs inline
    schema_changes_external_test.go:397: trying migration, expecting to fail
    schema_changes_external_test.go:406: intercepting the schema job
    schema_changes_external_test.go:422: intercepted schema change job: 847787294144790529
    schema_changes_external_test.go:429: canceling the migration job
    schema_changes_external_test.go:434: waiting for the migration job to finish.
    schema_changes_external_test.go:463: retrying migration, expecting to succeed
    schema_changes_external_test.go:472: resuming the schema change job
    schema_changes_external_test.go:497: waiting for the new migration job to complete.
    schema_changes_external_test.go:517: -- test log scope end --
=== RUN   TestMigrationWithFailures/adding_index
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/194b1b11adb2bb86a3c51c4924595952/logTestMigrationWithFailures_adding_index2454347597
    test_log_scope.go:79: use -show-logs to present logs inline
    schema_changes_external_test.go:397: trying migration, expecting to fail
    schema_changes_external_test.go:406: intercepting the schema job
    schema_changes_external_test.go:422: intercepted schema change job: 847787325077946369
    schema_changes_external_test.go:429: canceling the migration job
    schema_changes_external_test.go:434: waiting for the migration job to finish.
    schema_changes_external_test.go:463: retrying migration, expecting to succeed
    schema_changes_external_test.go:472: resuming the schema change job
    schema_changes_external_test.go:497: waiting for the new migration job to complete.
    schema_changes_external_test.go:517: -- test log scope end --
=== RUN   TestMigrationWithFailures/fail_adding_columns
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/194b1b11adb2bb86a3c51c4924595952/logTestMigrationWithFailures_fail_adding_columns3385476765
    test_log_scope.go:79: use -show-logs to present logs inline
    schema_changes_external_test.go:397: trying migration, expecting to fail
    schema_changes_external_test.go:406: intercepting the schema job
    schema_changes_external_test.go:422: intercepted schema change job: 847787350060138497
    schema_changes_external_test.go:429: canceling the migration job
    schema_changes_external_test.go:434: waiting for the migration job to finish.
    schema_changes_external_test.go:463: retrying migration, expecting to succeed
    schema_changes_external_test.go:468: waiting for the migration job to observe a mutation
    schema_changes_external_test.go:472: resuming the schema change job
    schema_changes_external_test.go:482: waiting for the schema job to reach the cancel status
    schema_changes_external_test.go:497: waiting for the new migration job to complete.
    schema_changes_external_test.go:517: -- test log scope end --
=== RUN   TestMigrationWithFailures/fail_adding_index
    test_log_scope.go:161: test logs captured to: /artifacts/tmp/_tmp/194b1b11adb2bb86a3c51c4924595952/logTestMigrationWithFailures_fail_adding_index511149566
    test_log_scope.go:79: use -show-logs to present logs inline
    schema_changes_external_test.go:397: trying migration, expecting to fail
    schema_changes_external_test.go:406: intercepting the schema job
    schema_changes_external_test.go:422: intercepted schema change job: 847787385062424577
    schema_changes_external_test.go:429: canceling the migration job
    schema_changes_external_test.go:434: waiting for the migration job to finish.
    schema_changes_external_test.go:463: retrying migration, expecting to succeed
    schema_changes_external_test.go:468: waiting for the migration job to observe a mutation
    schema_changes_external_test.go:472: resuming the schema change job
    schema_changes_external_test.go:482: waiting for the schema job to reach the cancel status
    schema_changes_external_test.go:497: waiting for the new migration job to complete.

Parameters: TAGS=bazel,gss,deadlock

Help

See also: How To Investigate a Go Test Failure (internal)

/cc @cockroachdb/sql-schema

This test on roachdash | Improve this report!

Jira issue: CRDB-25335

Metadata

Metadata

Assignees

Labels

C-test-failureBroken test (automatically or manually discovered).GA-blockerO-robotOriginated from a bot.T-sql-foundationsSQL Foundations Team (formerly SQL Schema + SQL Sessions)branch-masterFailures and bugs on the master branch.branch-release-23.1Used to mark GA and release blockers, technical advisories, and bugs for 23.1

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions