Skip to content

CI: K8sDatapathConfig ManagedEtcd Check connectivity with managed etcd #11181

@aanm

Description

@aanm

CI failure

/home/jenkins/workspace/Cilium-PR-Ginkgo-Tests-Kernel/k8s-1.17-gopath/src/github.com/cilium/cilium/test/ginkgo-ext/scopes.go:430
cilium pre-flight checks failed
Expected
    <*errors.errorString | 0xc000538fc0>: {
        s: "CiliumPreFlightCheck error: Timeout reached: PreflightCheck failed: Last polled error: controllers are failing: cilium-agent 'cilium-dgj24': controller endpoint-3621-regeneration-recovery is failing: Exitcode: 0 \nStdout:\n \t KVStore:                Ok   etcd: 1/1 connected, lease-ID=39ce71bbda93c422, lock lease-ID=39ce71bbda93c424, has-quorum=true: https://cilium-etcd-client.kube-system.svc:2379 - 3.3.12\n\t Kubernetes:             Ok   1.17 (v1.17.5) [linux/amd64]\n\t Kubernetes APIs:        [\"CustomResourceDefinition\", \"cilium/v2::CiliumClusterwideNetworkPolicy\", \"cilium/v2::CiliumNetworkPolicy\", \"core/v1::Namespace\", \"core/v1::Pods\", \"core/v1::Service\", \"discovery/v1beta1::EndpointSlice\", \"networking.k8s.io/v1::NetworkPolicy\"]\n\t KubeProxyReplacement:   Probe   [HostReachableServices (TCP, UDP)]\n\t Cilium:                 Ok      OK\n\t NodeMonitor:            Disabled\n\t Cilium health daemon:   Ok   \n\t IPAM:                   IPv4: 10/255 allocated from 10.10.1.0/24, IPv6: 9/4294967295 allocated from f00d::a0a:100:0:0/96\n\t Controller Status:      65/66 healthy\n\t   Name                                        Last success   Last error   Count   Message\n\t   cilium-health-ep                            26s ago        never        0       no error                       \n\t   dns-garbage-collector-job                   37s ago        never        0       no error                       \n\t   endpoint-1280-regeneration-recovery         never          never        0       no error                       \n\t   endpoint-1908-regeneration-recovery         never          never        0       no error                       \n\t   endpoint-2851-regeneration-recovery         never          never        0       no error                       \n\t   endpoint-3621-regeneration-recovery         never          22s ago      16      regeneration recovery failed   \n\t   endpoint-3929-regeneration-recovery         never          never        0       no error                       \n\t   endpoint-612-regeneration-recovery          never          never        0       no error                       \n\t   endpoint-641-regeneration-recovery          never          never        0       no error                       \n\t   endpoint-819-regeneration-recovery          never          never        0       no error                       \n\t   endpoint-90-regeneration-recovery           never          never        0       no error                       \n\t   ipcache-bpf-garbage-collection              4m11s ago      never        0       no error                       \n\t   k8s-heartbeat                               12s ago        never        0       no error                       \n\t   kvstore-etcd-lock-session-renew             never          never        0       no error                       \n\t   kvstore-etcd-session-renew                  never          never        0       no error                       \n\t   kvstore-locks-gc                            7s ago         never        0       no error                       \n\t   kvstore-sync-store-cilium/state/nodes/v1    4m11s ago      never        0       no error                       \n\t   mark-k8s-node-as-available                  4m27s ago      never        0       no error                       \n\t   metricsmap-bpf-prom-sync                    2s ago         never        0       no error                       \n\t   propagating local node change to kv-store   4m11s ago      never        0       no error                       \n\t   resolve-identity-1280                       4m24s ago      never        0       no error                       \n\t   resolve-identity-1908                       4m26s ago      never        0       no error                       \n\t   resolve-identity-2851                       4m24s ago      never        0       no error                       \n\t   resolve-identity-3929                       3m18s ago      never        0       no error                       \n\t   resolve-identity-612                        4m23s ago      never        0       no error                       \n\t   resolve-identity-641                        4m26s ago      never        0       no error                       \n\t   resolve-identity-819                        4m24s ago      never        0       no error                       \n\t   resolve-identity-90                         4m26s ago      never        0       no error                       \n\t   sync-IPv4-identity-mapping (1280)           4m11s ago      never        0       no error                       \n\t   sync-IPv4-identity-mapping (1908)           4m11s ago      never        0       no error                       \n\t   sync-IPv4-identity-mapping (2851)           4m11s ago      never        0       no error                       \n\t   sync-IPv4-identity-mapping (3621)           4m11s ago      never        0       no error                       \n\t   sync-IPv4-identity-mapping (3929)           3m18s ago      never        0       no error                       \n\t   sync-IPv4-identity-mapping (612)            4m11s ago      never        0       no error                       \n\t   sync-IPv4-identity-mapping (641)            4m11s ago      never        0       no error                       \n\t   sync-IPv4-identity-mapping (819)            4m11s ago      never        0       no error                       \n\t   sync-IPv4-identity-mapping (90)             4m11s ago      never        0       no error                       \n\t   sync-IPv6-identity-mapping (1280)           4m11s ago      never        0       no error                       \n\t   sync-IPv6-identity-mapping (1908)           4m11s ago      never        0       no error                       \n\t   sync-IPv6-identity-mapping (2851)           4m11s ago      never        0       no error                       \n\t   sync-IPv6-identity-mapping (3929)           3m18s ago      never        0       no error                       \n\t   sync-IPv6-identity-mapping (612)            4m11s ago      never        0       no error                       \n\t   sync-IPv6-identity-mapping (641)            4m11s ago      never        0       no error                       \n\t   sync-IPv6-identity-mapping (819)            4m11s ago      never        0       no error                       \n\t   sync-IPv6-identity-mapping (90)             4m11s ago      never        0       no error                       \n\t   sync-endpoints-and-host-ips                 37s ago        never        0       no error                       \n\t   sync-lb-maps-with-k8s-services              4m27s ago      never        0       no error                       \n\t   sync-policymap-1280                         24s ago        never        0       no error                       \n\t   sync-policymap-1908                         24s ago        never        0       no error                       \n\t   sync-policymap-2851                         24s ago        never        0       no error                       \n\t   sync-policymap-3929                         18s ago        never        0       no error                       \n\t   sync-policymap-612                          22s ago        never        0       no error                       \n\t   sync-policymap-641                          24s ago        never        0       no error                       \n\t   sync-policymap-819                          24s ago        never        0       no error                       \n\t   sync-policymap-90                           24s ago        never        0       no error                       \n\t   sync-to-k8s-ciliumendpoint (1280)           4s ago         never        0       no error                       \n\t   sync-to-k8s-ciliumendpoint (1908)           6s ago         never        0       no error                       \n\t   sync-to-k8s-ciliumendpoint (2851)           4s ago         never        0       no error                       \n\t   sync-to-k8s-ciliumendpoint (3621)           7s ago         never        0       no error                       \n\t   sync-to-k8s-ciliumendpoint (3929)           8s ago         never        0       no error                       \n\t   sync-to-k8s-ciliumendpoint (612)            2s ago         never        0       no error                       \n\t   sync-to-k8s-ciliumendpoint (641)            6s ago         never        0       no error                       \n\t   sync-to-k8s-ciliumendpoint (819)            4s ago         never        0       no error                       \n\t   sync-to-k8s-ciliumendpoint (90)             6s ago         never        0       no error                       \n\t   template-dir-watcher                        never          never        0       no error                       \n\t   update-k8s-node-annotations                 5m40s ago      never        0       no error                       \n\t Proxy Status:     OK, ip 10.10.1.110, 0 redirects active on ports 10000-20000\n\t Hubble:           Disabled\n\t Cluster health:   2/2 reachable   (2020-04-27T13:40:25Z)\n\t \nStderr:\n \t \n",
    }
to be nil
/home/jenkins/workspace/Cilium-PR-Ginkgo-Tests-Kernel/k8s-1.17-gopath/src/github.com/cilium/cilium/test/k8sT/assertionHelpers.go:138

https://jenkins.cilium.io/job/Cilium-PR-Ginkgo-Tests-Kernel/869/testReport/Suite-k8s-1/17/K8sDatapathConfig_ManagedEtcd_Check_connectivity_with_managed_etcd/

1ed910e0_K8sDatapathConfig_ManagedEtcd_Check_connectivity_with_managed_etcd.zip

Metadata

Metadata

Assignees

Labels

area/CIContinuous Integration testing issue or flakeci/flakeThis is a known failure that occurs in the tree. Please investigate me!kind/bug/CIThis is a bug in the testing code.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions