Skip to content

gossip: TestClientNodeID failed [grpc data race] #68145

@cockroach-teamcity

Description

@cockroach-teamcity

gossip.TestClientNodeID failed with artifacts on master @ 8009ac6bb63f455a18bb1139d505bdd9930816b7:

      /go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:1069 +0x94
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      /go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:442 +0x161

Previous write at 0x00c0002d84e0 by goroutine 115:
  google.golang.org/grpc/internal/transport.(*http2Client).operateHeaders()
      /go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1295 +0x2309
  google.golang.org/grpc/internal/transport.(*http2Client).reader()
      /go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:1484 +0xdb1

Goroutine 112 (running) created at:
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx()
      /go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:434 +0x28d
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTask()
      /go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:334 +0x494
  github.com/cockroachdb/cockroach/pkg/rpc.(*Context).grpcDialNodeInternal.func1()
      /go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:1067 +0x3c1
  sync.(*Once).doSlow()
      /usr/local/go/src/sync/once.go:68 +0x109
  sync.(*Once).Do()
      /usr/local/go/src/sync/once.go:59 +0x68
  github.com/cockroachdb/cockroach/pkg/rpc.(*Context).grpcDialNodeInternal()
      /go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:1061 +0x25c
  github.com/cockroachdb/cockroach/pkg/rpc.(*Context).GRPCUnvalidatedDial()
      /go/src/github.com/cockroachdb/cockroach/pkg/rpc/context.go:1010 +0xd5
  github.com/cockroachdb/cockroach/pkg/gossip.(*client).startLocked.func1.2()
      /go/src/github.com/cockroachdb/cockroach/pkg/gossip/client.go:108 +0x5c
  github.com/cockroachdb/circuitbreaker.(*Breaker).CallContext()
      /go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/circuitbreaker/circuitbreaker.go:385 +0x83
  github.com/cockroachdb/circuitbreaker.(*Breaker).Call()
      /go/src/github.com/cockroachdb/cockroach/vendor/github.com/cockroachdb/circuitbreaker/circuitbreaker.go:370 +0x364
  github.com/cockroachdb/cockroach/pkg/gossip.(*client).startLocked.func1()
      /go/src/github.com/cockroachdb/cockroach/pkg/gossip/client.go:103 +0x1bf
  github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2()
      /go/src/github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:442 +0x161

Goroutine 115 (running) created at:
  google.golang.org/grpc/internal/transport.newHTTP2Client()
      /go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/http2_client.go:346 +0x1488
  google.golang.org/grpc/internal/transport.NewClientTransport()
      /go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/internal/transport/transport.go:574 +0x6c7
  google.golang.org/grpc.(*addrConn).createTransport()
      /go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/clientconn.go:1328 +0x4f7
  google.golang.org/grpc.(*addrConn).tryAllAddrs()
      /go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/clientconn.go:1258 +0x507
  google.golang.org/grpc.(*addrConn).resetTransport()
      /go/src/github.com/cockroachdb/cockroach/vendor/google.golang.org/grpc/clientconn.go:1173 +0x33b
==================
    testing.go:1092: race detected during execution of test
--- FAIL: TestClientNodeID (0.01s)
Reproduce

To reproduce, try:

make stressrace TESTS=TestClientNodeID PKG=./pkg/gossip TESTTIMEOUT=5m STRESSFLAGS='-timeout 5m' 2>&1

Parameters in this failure:

  • GOFLAGS=-race -parallel=4

/cc @cockroachdb/kv es-chow

This test on roachdash | Improve this report!

Metadata

Metadata

Assignees

No one assigned

    Labels

    C-test-failureBroken test (automatically or manually discovered).O-robotOriginated from a bot.branch-masterFailures and bugs on the master branch.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions