2018-04-27T20:51:15.996491Z warn endpoints for service cluster "inbound|http-monitoring||istio-pilot.istio-system.svc.cluster.local" returned error "1 error occurred:\n\n* missing service name and namespace from the service hostname \"inbound\""
2018-04-27T20:51:15.996574Z info EDS: remove unused cluster node=sidecar~57.112.0.195~istio-pilot-8c8cdc64f-7mjgf.istio-system~istio-system.svc.cluster.local-5 cluster=inbound|http-monitoring||istio-pilot.istio-system.svc.cluster.local all=map[outbound|prometheus||istio-telemetry.istio-system.svc.cluster.local:0xc42096bf40 outbound|http2-mixer||istio-telemetry.istio-system.svc.cluster.local:0xc420f1c050 outbound|57-112-0-55||host-57-112-0-55.istio-system.svc.cluster.local:0xc42096b810 outbound|57-112-0-52||host-57-112-0-52.istio-system.svc.cluster.local:0xc42096ba40 outbound|https||istio-ingress.istio-system.svc.cluster.local:0xc42096bb30 outbound|http||ratings.default.svc.cluster.local:0xc42096bbd0 outbound|tcp||istio-ingressgateway.istio-system.svc.cluster.local:0xc42096bc70 outbound|statsd-prom||istio-statsd-prom-bridge.istio-system.svc.cluster.local:0xc42096bdb0 outbound|57-112-0-53||host-57-112-0-53.istio-system.svc.cluster.local:0xc42096b090 outbound|57-112-0-58||host-57-112-0-58.istio-system.svc.cluster.local:0xc42096b310 outbound|https||istio-ingressgateway.istio-system.svc.cluster.local:0xc42096bcc0 outbound|grpc-citadel||istio-citadel.istio-system.svc.cluster.local:0xc42096be50 outbound|http-legacy-discovery||istio-pilot.istio-system.svc.cluster.local:0xc420f1c280 outbound|http-discovery||istio-pilot.istio-system.svc.cluster.local:0xc420f1c370 outbound|http-monitoring||istio-pilot.istio-system.svc.cluster.local:0xc420f1c230 outbound|grpc-xds||istio-pilot.istio-system.svc.cluster.local:0xc420f1c320 outbound|57-112-0-50||host-57-112-0-50.istio-system.svc.cluster.local:0xc42096b860 outbound|http||istio-ingressgateway.istio-system.svc.cluster.local:0xc42096bd10 outbound|http-monitoring||istio-citadel.istio-system.svc.cluster.local:0xc42096be00 outbound|http-monitoring||istio-telemetry.istio-system.svc.cluster.local:0xc42096bf90 outbound|tcp-mtls||istio-telemetry.istio-system.svc.cluster.local:0xc420f1c000 outbound|http2-mixer||istio-policy.istio-system.svc.cluster.local:0xc420f1c140 outbound|57-112-0-59||host-57-112-0-59.istio-system.svc.cluster.local:0xc42096b0e0 outbound|http||details.default.svc.cluster.local:0xc42096bef0 outbound|https-discovery||istio-pilot.istio-system.svc.cluster.local:0xc420f1c3c0 outbound|dns-tcp||kube-dns.kube-system.svc.cluster.local:0xc420f1c460 outbound|https||istio-egressgateway.istio-system.svc.cluster.local:0xc420f1c500 outbound|https||kubernetes.default.svc.cluster.local:0xc42096bc20 outbound|http||centos-kube-5.default.svc.cluster.local:0xc42096bea0 outbound|http-monitoring||istio-policy.istio-system.svc.cluster.local:0xc420f1c0a0 outbound|https-xds||istio-pilot.istio-system.svc.cluster.local:0xc420f1c2d0 outbound|dns||kube-dns.kube-system.svc.cluster.local:0xc420f1c4b0 outbound|http||istio-egressgateway.istio-system.svc.cluster.local:0xc420f1c550 outbound|http||productpage.default.svc.cluster.local:0xc420f1c1e0 outbound|http-old-discovery||istio-pilot.istio-system.svc.cluster.local:0xc420f1c410 outbound|57-112-0-56||host-57-112-0-56.istio-system.svc.cluster.local:0xc42096b270 outbound|57-112-0-57||host-57-112-0-57.istio-system.svc.cluster.local:0xc42096b2c0 outbound|57-112-0-51||host-57-112-0-51.istio-system.svc.cluster.local:0xc42096b9f0 outbound|statsd-udp||istio-statsd-prom-bridge.istio-system.svc.cluster.local:0xc42096bd60 outbound|tcp-mtls||istio-policy.istio-system.svc.cluster.local:0xc420f1c0f0 outbound|http-prometheus||prometheus.istio-system.svc.cluster.local:0xc420f1c190 inbound|http-monitoring||istio-pilot.istio-system.svc.cluster.local:0xc4203da910 outbound|http||reviews.default.svc.cluster.local:0xc42096bae0 outbound|57-112-0-54||host-57-112-0-54.istio-system.svc.cluster.local:0xc42096ba90 outbound|http||istio-ingress.istio-system.svc.cluster.local:0xc42096bb80]
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x18 pc=0x14b6f0a]
goroutine 4461 [running]:
istio.io/istio/pilot/pkg/proxy/envoy/v2.(*DiscoveryServer).pushEds(0xc4204ea3c0, 0xc42078e270, 0xc4210b58b8, 0x3)
/home/sbezverk/developing/go/src/istio.io/istio/pilot/pkg/proxy/envoy/v2/eds.go:366 +0x18a
istio.io/istio/pilot/pkg/proxy/envoy/v2.(*DiscoveryServer).StreamAggregatedResources(0xc4204ea3c0, 0x23b50c0, 0xc420203d80, 0x0, 0x0)
/home/sbezverk/developing/go/src/istio.io/istio/pilot/pkg/proxy/envoy/v2/ads.go:262 +0x14de
istio.io/istio/vendor/github.com/envoyproxy/go-control-plane/envoy/service/discovery/v2._AggregatedDiscoveryService_StreamAggregatedResources_Handler(0x1838620, 0xc4204ea3c0, 0x23b3c80, 0xc4204206e0, 0x2447688, 0xc4208b93b0)
/home/sbezverk/developing/go/src/istio.io/istio/vendor/github.com/envoyproxy/go-control-plane/envoy/service/discovery/v2/ads.pb.go:129 +0xb2
istio.io/istio/vendor/google.golang.org/grpc.(*Server).processStreamingRPC(0xc4207231e0, 0x23b49a0, 0xc420c1b680, 0xc420251b80, 0xc4207b13b0, 0x240fda0, 0xc4208b9260, 0x0, 0x0)
/home/sbezverk/developing/go/src/istio.io/istio/vendor/google.golang.org/grpc/server.go:1059 +0xa90
istio.io/istio/vendor/google.golang.org/grpc.(*Server).handleStream(0xc4207231e0, 0x23b49a0, 0xc420c1b680, 0xc420251b80, 0xc4208b9260)
/home/sbezverk/developing/go/src/istio.io/istio/vendor/google.golang.org/grpc/server.go:1152 +0x14c1
istio.io/istio/vendor/google.golang.org/grpc.(*Server).serveStreams.func1.1(0xc420483900, 0xc4207231e0, 0x23b49a0, 0xc420c1b680, 0xc420251b80)
/home/sbezverk/developing/go/src/istio.io/istio/vendor/google.golang.org/grpc/server.go:637 +0x9f
created by istio.io/istio/vendor/google.golang.org/grpc.(*Server).serveStreams.func1
/home/sbezverk/developing/go/src/istio.io/istio/vendor/google.golang.org/grpc/server.go:635 +0xa1
pilot consistently crashing when EDS request is sent for
inbound|http-monitoring||istio-pilot.istio-system.svc.cluster.local.updateClusterfunction can fail and return prematurely, but parent function is not aware of this condition and generates nil pointer exception.