-
Notifications
You must be signed in to change notification settings - Fork 4.1k
jobs: TestRegistryLifecycle failed #45131
Copy link
Copy link
Closed
Labels
C-test-failureBroken test (automatically or manually discovered).Broken test (automatically or manually discovered).O-robotOriginated from a bot.Originated from a bot.branch-masterFailures and bugs on the master branch.Failures and bugs on the master branch.
Milestone
Description
(jobs).TestRegistryLifecycle failed on master@5c37cf2d12bafd4a01d4ac7f1725a0ae6e498c9c:
=== RUN TestRegistryLifecycle/cancel
I200215 02:29:49.146140 5234 base/addr_validation.go:296 [n?] server certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
I200215 02:29:49.146168 5234 base/addr_validation.go:342 [n?] web UI certificate addresses: IP=127.0.0.1,::1; DNS=localhost,*.local; CN=node
W200215 02:29:49.168950 5234 server/status/runtime.go:308 [n?] Could not parse build timestamp: parsing time "" as "2006/01/02 15:04:05": cannot parse "" as "2006"
I200215 02:29:49.176609 5234 server/server.go:998 [n?] monitoring forward clock jumps based on server.clock.forward_jump_check_enabled
I200215 02:29:49.192917 5234 server/config.go:566 [n?] 1 storage engine initialized
I200215 02:29:49.192944 5234 server/config.go:569 [n?] RocksDB cache size: 128 MiB
I200215 02:29:49.192954 5234 server/config.go:569 [n?] store 0: in-memory, size 0 B
I200215 02:29:49.193064 5234 server/server.go:1453 [n?] no stores bootstrapped and --join flag specified, awaiting init command or join with an already initialized node.
I200215 02:29:49.193107 5234 server/server.go:1463 [n?] **** add additional nodes by specifying --join=127.0.0.1:43003
I200215 02:29:49.205987 5234 server/node.go:334 [n?] **** cluster ca4080cc-be93-4c8e-b5fb-0c9b92342674 has been created
I200215 02:29:49.206289 5234 gossip/gossip.go:395 [n1] NodeDescriptor set to node_id:1 address:<network_field:"tcp" address_field:"127.0.0.1:43003" > attrs:<> locality:<> ServerVersion:<major_val:19 minor_val:2 patch:0 unstable:12 > build_tag:"v20.1.0-alpha.20191118-2194-g5c37cf2" started_at:1581733789206198749 cluster_name:"" sql_address:<network_field:"tcp" address_field:"127.0.0.1:41857" >
I200215 02:29:49.224124 5234 server/node.go:438 [n1] initialized store [n1,s1]: disk (capacity=512 MiB, available=512 MiB, used=0 B, logicalBytes=13 KiB), ranges=28, leases=0, queries=0.00, writes=0.00, bytesPerReplica={p10=0.00 p25=0.00 p50=0.00 p75=0.00 p90=950.00 pMax=11278.00}, writesPerReplica={p10=0.00 p25=0.00 p50=0.00 p75=0.00 p90=0.00 pMax=0.00}
I200215 02:29:49.224374 5234 storage/stores.go:234 [n1] read 0 node addresses from persistent storage
W200215 02:29:49.224467 5364 storage/store.go:1538 [n1,s1,r6/1:/Table/{SystemCon…-11}] could not gossip system config: [NotLeaseHolderError] r6: replica (n1,s1):1 not lease holder; lease holder unknown
I200215 02:29:49.224534 5234 server/node.go:655 [n1] connecting to gossip network to verify cluster ID...
I200215 02:29:49.224826 5234 server/node.go:675 [n1] node connected via gossip and verified as part of cluster "ca4080cc-be93-4c8e-b5fb-0c9b92342674"
I200215 02:29:49.225280 5234 server/node.go:522 [n1] node=1: started with [<no-attributes>=<in-mem>] engine(s) and attributes []
I200215 02:29:49.225668 5234 server/server.go:2141 [n1] Could not start goroutine dumper worker due to: directory to store dumps could not be determined
I200215 02:29:49.225907 5234 server/server.go:1583 [n1] starting https server at 127.0.0.1:44243 (use: 127.0.0.1:44243)
I200215 02:29:49.226079 5234 server/server.go:1588 [n1] starting postgres server at 127.0.0.1:41857 (use: 127.0.0.1:41857)
I200215 02:29:49.226110 5234 server/server.go:1590 [n1] starting grpc server at 127.0.0.1:43003
I200215 02:29:49.226433 5234 server/server.go:1591 [n1] advertising CockroachDB node at 127.0.0.1:43003
I200215 02:29:49.312044 5475 sql/event_log.go:132 [n1,intExec=optInToDiagnosticsStatReporting] Event: "set_cluster_setting", target: 0, info: {SettingName:diagnostics.reporting.enabled Value:true User:root}
I200215 02:29:49.334785 4219 sql/event_log.go:132 [n1,intExec=set-setting] Event: "set_cluster_setting", target: 0, info: {SettingName:version Value:19.2-12 User:root}
I200215 02:29:49.351946 5822 sql/event_log.go:132 [n1,intExec=initializeClusterSecret] Event: "set_cluster_setting", target: 0, info: {SettingName:cluster.secret Value:2561729b-fc5c-44dd-8a06-4886ab95d323 User:root}
I200215 02:29:49.358396 5829 sql/event_log.go:132 [n1,intExec=create-default-db] Event: "create_database", target: 50, info: {DatabaseName:defaultdb Statement:CREATE DATABASE IF NOT EXISTS defaultdb User:root}
I200215 02:29:49.364123 5906 sql/event_log.go:132 [n1,intExec=create-default-db] Event: "create_database", target: 51, info: {DatabaseName:postgres Statement:CREATE DATABASE IF NOT EXISTS postgres User:root}
I200215 02:29:49.427231 5234 server/server.go:1665 [n1] done ensuring all necessary migrations have run
I200215 02:29:49.427279 5234 server/server.go:1946 [n1] serving sql connections
I200215 02:29:49.432756 6065 sql/event_log.go:132 [n1] Event: "node_join", target: 1, info: {Descriptor:{NodeID:1 Address:127.0.0.1:43003 Attrs: Locality: ServerVersion:19.2-12 BuildTag:v20.1.0-alpha.20191118-2194-g5c37cf2 StartedAt:1581733789206198749 LocalityAddress:[] ClusterName: SQLAddress:127.0.0.1:41857} ClusterID:ca4080cc-be93-4c8e-b5fb-0c9b92342674 StartedAt:1581733789206198749 LastUp:1581733789206198749}
I200215 02:29:49.434951 6063 server/server_update.go:55 [n1] no need to upgrade, cluster already at the newest version
I200215 02:29:49.444053 5839 jobs/registry.go:669 [n1] job 529738594492678145: stepping through state running with error <nil>
I200215 02:29:49.483725 5234 util/stop/stopper.go:539 quiescing
I200215 02:29:49.483868 5839 jobs/registry.go:669 [n1] job 529738594492678145: stepping through state succeeded with error <nil>
W200215 02:29:49.483922 5839 internal/client/txn.go:566 [n1] failure aborting transaction: node unavailable; try another peer; abort caused by: context canceled
E200215 02:29:49.483958 6101 jobs/registry.go:407 error while adopting jobs: job 529738594492678145: can't query system.jobs: job-status: failed to send RPC: sending to all 1 replicas failed; last error: (err: node unavailable; try another peer) <nil>
I200215 02:29:49.483959 5839 jobs/registry.go:669 [n1] job 529738594492678145: stepping through state reverting with error could not mark job 529738594492678145 as succeeded: context canceled
W200215 02:29:49.484013 5839 internal/client/txn.go:566 [n1] failure aborting transaction: node unavailable; try another peer; abort caused by: context canceled
E200215 02:29:49.484113 5839 jobs/registry.go:802 [n1] job 529738594492678145: adoption completed with error job 529738594492678145: could not mark as reverting: could not mark job 529738594492678145 as succeeded: context canceled: context canceled
W200215 02:29:49.484132 5839 internal/client/txn.go:566 [n1] failure aborting transaction: node unavailable; try another peer; abort caused by: context canceled
E200215 02:29:49.484142 5839 jobs/registry.go:806 [n1] job 529738594492678145: failed querying status: context canceled
W200215 02:29:49.484883 6082 storage/intentresolver/intent_resolver.go:838 failed to gc transaction record: could not GC completed transaction anchored at /Table/SystemConfigSpan/Start: node unavailable; try another peer
E200215 02:29:49.485737 6101 jobs/registry.go:407 error while adopting jobs: failed querying for jobs: adopt-job: node unavailable; try another peer
E200215 02:29:49.489311 6101 jobs/registry.go:407 error while adopting jobs: failed querying for jobs: adopt-job: node unavailable; try another peer
E200215 02:29:49.490997 6101 jobs/registry.go:407 error while adopting jobs: failed querying for jobs: adopt-job: node unavailable; try another peer
--- FAIL: TestRegistryLifecycle/cancel (0.35s)
jobs_test.go:189: Starting resume
jobs_test.go:378: unexpected <nil>
jobs_test.go:197: Exiting resume
More
Parameters:
- GOFLAGS=-json
make stressrace TESTS=TestRegistryLifecycle PKG=./pkg/jobs TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1
See this test on roachdash
powered by pkg/cmd/internal/issues
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
C-test-failureBroken test (automatically or manually discovered).Broken test (automatically or manually discovered).O-robotOriginated from a bot.Originated from a bot.branch-masterFailures and bugs on the master branch.Failures and bugs on the master branch.