Based on current findings in integration tests on arm, I think tailoring test set is a more feasible way to bring back CI on arm.
I have an idea to make a minimum integration test case set:

Currently we test following folders in integration test:
./integration-cli/
./integration/network/
./integration/network/ipvlan/
./integration/network/macvlan/
./integration/image/
./integration/container/
./integration/config/
./integration/volume/
./integration/build/
./integration/plugin/
./integration/plugin/volumes/
./integration/plugin/volumes/cmd/
./integration/plugin/volumes/cmd/dummy/
./integration/plugin/graphdriver/
./integration/plugin/authz/
./integration/plugin/logging/
./integration/plugin/logging/cmd/
./integration/plugin/logging/cmd/close_on_start/
./integration/plugin/logging/cmd/dummy/
./integration/plugin/common/
./integration/system/
./integration/secret/
./integration/session/
./integration/service/
On arm we can select some of them that are most critical and most probably architecture relevant to test. For example:
./integration-cli/
./integration/system/
./integration/image/
./integration/container/
./integration/plugin/common/
./integration/system/
(I am not sure whether this is a good selection or not, open for discussion.)

Specifically we can modify code like this to implement the minimal test set:

Add variable integration_api_dirs_mini in hack/make/.integration-test-helpers to contain the small collection of test dirs (mentioned above).
Add a function run_test_integration_suites_mini() in hack/make/.integration-test-helpers to test integration_api_dirs_mini folders, like https://github.com/moby/moby/blob/master/hack/make/.integration-test-helpers#L31
Add file hack/make/test-integration-mini to call run_test_integration_suites_mini. hack/make/test-integration-mini would be quite similar to hack/make/test-integration.
In hack/ci/arm, replace test-integration with test-integration-mini.

Ping @thaJeztah and @psftw , could you give some comments?
I can make a PR to discuss the detail.

Jenkins CI for arm64 #39479

Description

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions