Flaky test: cgroup2: TestInspectOomKilledTrue fails intermittently

**Description**



As of f266f13965d5bfb1825afa181fe6c32f3a597fa3, `TestInspectOomKilledTrue` fails intermittently  on cgroup v2 hosts

https://github.com/moby/moby/blob/f266f13965d5bfb1825afa181fe6c32f3a597fa3/integration/container/kill_test.go#L154-L172

**Steps to reproduce the issue:**
```console
$ make TEST_SKIP_INTEGRATION_CLI=1 TESTFLAGS="-test.run TestInspectOomKilledTrue -test.count 10" test-integration 
```


**Describe the results you received:**

1 PASS, 9 FAIL

```
=== RUN   TestInspectOomKilledTrue                                                                               
--- FAIL: TestInspectOomKilledTrue (1.15s)                                                                       
    kill_test.go:171: assertion failed: true (true bool) != false (inspect.State.OOMKilled bool)
=== RUN   TestInspectOomKilledTrue                                                                               
--- FAIL: TestInspectOomKilledTrue (0.63s)                                                                       
    kill_test.go:171: assertion failed: true (true bool) != false (inspect.State.OOMKilled bool)
=== RUN   TestInspectOomKilledTrue
--- FAIL: TestInspectOomKilledTrue (0.59s)
    kill_test.go:171: assertion failed: true (true bool) != false (inspect.State.OOMKilled bool)
=== RUN   TestInspectOomKilledTrue              
--- FAIL: TestInspectOomKilledTrue (0.64s)
    kill_test.go:171: assertion failed: true (true bool) != false (inspect.State.OOMKilled bool)
=== RUN   TestInspectOomKilledTrue                  
--- FAIL: TestInspectOomKilledTrue (0.62s)
    kill_test.go:171: assertion failed: true (true bool) != false (inspect.State.OOMKilled bool)
=== RUN   TestInspectOomKilledTrue                                                                               
--- FAIL: TestInspectOomKilledTrue (0.66s)
    kill_test.go:171: assertion failed: true (true bool) != false (inspect.State.OOMKilled bool)
=== RUN   TestInspectOomKilledTrue
--- PASS: TestInspectOomKilledTrue (0.61s)        
=== RUN   TestInspectOomKilledTrue                                                                               --- FAIL: TestInspectOomKilledTrue (0.64s)       
    kill_test.go:171: assertion failed: true (true bool) != false (inspect.State.OOMKilled bool)
=== RUN   TestInspectOomKilledTrue
--- FAIL: TestInspectOomKilledTrue (0.62s)
    kill_test.go:171: assertion failed: true (true bool) != false (inspect.State.OOMKilled bool)
=== RUN   TestInspectOomKilledTrue
--- FAIL: TestInspectOomKilledTrue (0.61s)
    kill_test.go:171: assertion failed: true (true bool) != false (inspect.State.OOMKilled bool)
FAIL
```

**Describe the results you expected:**

10 PASS

**Additional information you deem important (e.g. issue happens only occasionally):**


- kernel cmdline: `systemd.unified_cgroup_hierarchy=1 cgroup_enable=memory swapaccount=1`
- `swapon -a` and `swapoff -a` do not change the result.
- The test seems stable on v1 hosts

**Output of `docker version`:**

```
Client:
 Version:           20.10.0-dev
 API version:       1.41
 Go version:        go1.13.15
 Git commit:        c6bb56136
 Built:             Tue Jan 26 08:46:11 2021
 OS/Arch:           linux/amd64
 Context:           default
 Experimental:      true

Server:
 Engine:
  Version:          dev
  API version:      1.41 (minimum version 1.12)
  Go version:       go1.13.15
  Git commit:       f266f13965
  Built:            Tue Jan 26 08:45:56 2021
  OS/Arch:          linux/amd64
  Experimental:     true
 containerd:
  Version:          v1.4.0-2523-g1230bd630
  GitCommit:        1230bd63031ba4b65709103b5cb8f5be78a43b75
 runc:
  Version:          1.0.0-rc92+dev
  GitCommit:        c69ae759fbf5acf6e8ef805471b99feee8246c3c
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0
```

**Output of `docker info`:**

```
Client:
 Context:    default
 Debug Mode: false
 Plugins:
  buildx: Build with BuildKit (Docker Inc., v0.5.1-3-g8b8725d)

Server:
 Containers: 0
  Running: 0
  Paused: 0
  Stopped: 0
 Images: 3
 Server Version: dev
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Native Overlay Diff: true
 Logging Driver: json-file
 Cgroup Driver: systemd
 Cgroup Version: 2
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
 Swarm: inactive
 Runtimes: io.containerd.runtime.v1.linux kata runsc-kvm sysbox-runc crun io.containerd.runc.v2 runsc runc runc-rc92
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: 1230bd63031ba4b65709103b5cb8f5be78a43b75
 runc version: c69ae759fbf5acf6e8ef805471b99feee8246c3c
 init version: de40ad0
 Security Options:
  apparmor
  seccomp
   Profile: default
  cgroupns
 Kernel Version: 5.8.0-40-generic
 Operating System: Ubuntu 20.10
 OSType: linux
 Architecture: x86_64
 CPUs: 4
 Total Memory: 15.61GiB
 Name: suda-ws01
 ID: E2YB:EGZO:6BNW:EPHS:4WFQ:EIDV:ZZ6D:QBZK:6673:CIOR:DLZ6:SI3D
 Docker Root Dir: /var/lib/docker
 Debug Mode: true
  File Descriptors: 22
  Goroutines: 34
  System Time: 2021-01-26T17:58:54.968084742+09:00
  EventsListeners: 0
 Username: akihirosuda
 Registry: https://index.docker.io/v1/
 Labels:
 Experimental: true
 Insecure Registries:
  127.0.0.0/8
 Live Restore Enabled: true

WARNING: Support for cgroup v2 is experimental
```

**Additional environment details (AWS, VirtualBox, physical, etc.):**
VMware Fusion

	func TestInspectOomKilledTrue(t *testing.T) {
	skip.If(t, testEnv.DaemonInfo.OSType == "windows")
	skip.If(t, testEnv.DaemonInfo.CgroupDriver == "none")
	skip.If(t, !testEnv.DaemonInfo.MemoryLimit \|\| !testEnv.DaemonInfo.SwapLimit)

	defer setupTest(t)()
	ctx := context.Background()
	client := testEnv.APIClient()

	cID := container.Run(ctx, t, client, container.WithCmd("sh", "-c", "x=a; while true; do x=$x$x$x$x; done"), func(c *container.TestContainerConfig) {
	c.HostConfig.Resources.Memory = 32 * 1024 * 1024
	})

	poll.WaitOn(t, container.IsInState(ctx, client, cID, "exited"), poll.WithDelay(100*time.Millisecond))

	inspect, err := client.ContainerInspect(ctx, cID)
	assert.NilError(t, err)
	assert.Check(t, is.Equal(true, inspect.State.OOMKilled))
	}

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Flaky test: cgroup2: TestInspectOomKilledTrue fails intermittently #41929

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Flaky test: cgroup2: TestInspectOomKilledTrue fails intermittently #41929

Description

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions