Skip to content

[Flaky Test] Kubernetes-unit-tests ^TestStatefulSetControl is being flaky #106663

Closed
Closed
[Flaky Test] Kubernetes-unit-tests ^TestStatefulSetControl is being flaky#106663
Assignees
mattcary
Labels
kind/flakeCategorizes issue or PR as related to a flaky test.priority/important-soonMust be staffed and worked on either currently, or very soon, ideally in time for the next release.sig/appsCategorizes an issue or PR as relevant to SIG Apps.sig/storageCategorizes an issue or PR as relevant to SIG Storage.sig/testingCategorizes an issue or PR as relevant to SIG Testing.triage/acceptedIndicates an issue or PR is ready to be actively worked on.
@Rajalakshmi-Girish

Description

@Rajalakshmi-Girish
Rajalakshmi-Girish
opened on Nov 24, 2021

Which jobs are flaking?

periodic-kubernetes-unit-test-ppc64le
Sample failed job: https://prow.k8s.io/view/gs/ppc64le-kubernetes/logs/periodic-kubernetes-unit-test-ppc64le/1463383575909896192

https://prow.k8s.io/job-history/gs/ppc64le-kubernetes/logs/periodic-kubernetes-unit-test-ppc64le

Which tests are flaking?

test TestStatefulSetControl and its sub tests under k8s.io/kubernetes/pkg/controller/statefulset

Since when has it been flaking?

Not sure about the start of failure.
Seems like present for more than a week.

Testgrid link

https://k8s-testgrid.appspot.com/sig-node-ppc64le#unit-tests

Reason for failure (if possible)

No response

Anything else we need to know?

Could see flakiness on both x86 and ppc architectures.

[root@toad1 kubernetes]# stress ./statefulset.test -test.run TestStatefulSetControl -test.v
5s: 0 runs so far, 0 failures
10s: 0 runs so far, 0 failures
15s: 0 runs so far, 0 failures
20s: 0 runs so far, 0 failures
25s: 0 runs so far, 0 failures
30s: 0 runs so far, 0 failures
35s: 0 runs so far, 0 failures
40s: 0 runs so far, 0 failures
45s: 0 runs so far, 0 failures
50s: 0 runs so far, 0 failures
55s: 0 runs so far, 0 failures
1m0s: 0 runs so far, 0 failures

/tmp/go-stress-20211124T095412-3710214002
=== RUN   TestStatefulSetControl
=== RUN   TestStatefulSetControl/CreatesPods/Monotonic/StatefulSetAutoDeletePVCDisabled
=== RUN   TestStatefulSetControl/CreatesPods/Monotonic/Retain/StatefulSetAutoDeletePVCEnabled
=== RUN   TestStatefulSetControl/CreatesPods/Monotonic/ScaleDownOnly/StatefulSetAutoDeletePVCEnabled
=== RUN   TestStatefulSetControl/CreatesPods/Monotonic/SetDeleteOnly/StatefulSetAutoDeletePVCEnabled
=== RUN   TestStatefulSetControl/CreatesPods/Monotonic/Delete/StatefulSetAutoDeletePVCEnabled
=== RUN   TestStatefulSetControl/CreatesPods/Burst/StatefulSetAutoDeletePVCDisabled
=== RUN   TestStatefulSetControl/CreatesPods/Burst/Retain/StatefulSetAutoDeletePVCEnabled
=== RUN   TestStatefulSetControl/CreatesPods/Burst/ScaleDownOnly/StatefulSetAutoDeletePVCEnabled
=== RUN   TestStatefulSetControl/CreatesPods/Burst/SetDeleteOnly/StatefulSetAutoDeletePVCEnabled
=== RUN   TestStatefulSetControl/CreatesPods/Burst/Delete/StatefulSetAutoDeletePVCEnabled
=== RUN   TestStatefulSetControl/ScalesUp/Monotonic/StatefulSetAutoDeletePVCDisabled
=== RUN   TestStatefulSetControl/ScalesUp/Monotonic/Retain/StatefulSetAutoDeletePVCEnabled
=== RUN   TestStatefulSetControl/ScalesUp/Monotonic/ScaleDownOnly/StatefulSetAutoDeletePVCEnabled
=== RUN   TestStatefulSetControl/ScalesUp/Monotonic/SetDeleteOnly/StatefulSetAutoDeletePVCEnabled
=== RUN   TestStatefulSetControl/ScalesUp/Monotonic/Delete/StatefulSetAutoDeletePVCEnabled
=== RUN   TestStatefulSetControl/ScalesUp/Burst/StatefulSetAutoDeletePVCDisabled
=== RUN   TestStatefulSetControl/ScalesUp/Burst/Retain/StatefulSetAutoDeletePVCEnabled
    stateful_set_control_test.go:220: Failed to turn up StatefulSet : persistentvolumeclaim "datadir-foo-0" not found
    stateful_set_control_test.go:224: Failed to scale StatefulSet : persistentvolumeclaim "datadir-foo-0" not found
    stateful_set_control_test.go:235: Failed to set readyReplicas correctly
=== RUN   TestStatefulSetControl/ScalesUp/Burst/ScaleDownOnly/StatefulSetAutoDeletePVCEnabled
=== RUN   TestStatefulSetControl/ScalesUp/Bu
…
1m5s: 4 runs so far, 1 failures (25.00%)
1m10s: 4 runs so far, 1 failures (25.00%)
1m15s: 4 runs so far, 1 failures (25.00%)
^C
[root@toad1 kubernetes]#

Relevant SIG(s)

/sig testing

Metadata

Metadata

Assignees

Labels

kind/flakeCategorizes issue or PR as related to a flaky test.priority/important-soonMust be staffed and worked on either currently, or very soon, ideally in time for the next release.sig/appsCategorizes an issue or PR as relevant to SIG Apps.sig/storageCategorizes an issue or PR as relevant to SIG Storage.sig/testingCategorizes an issue or PR as relevant to SIG Testing.triage/acceptedIndicates an issue or PR is ready to be actively worked on.

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions