Skip to content

[💡 Feature]: allow sharding tests for better scalability in large CI systems #11243

@muhqu

Description

@muhqu

Is your feature request related to a problem?

We have over 100 tests and like to run them across multiple test executors in our CI environment. A single machine can only run a few browsers in parallel due to memory consumption. Being able to run the tests across multiple machines allows for better scaling.

Describe the solution you'd like.

The playwright and vitest test runners support a --shard parameter, that evenly splits the number of tests to run.
e.g. if you have 100 tests --shard=1/4 would execute test 1-25, --shard=2/4 would execute test 26-50, etc…

Describe alternatives you've considered.

To work around the issue I can manually group tests in test suites and setup specific jobs to trigger each test suite to have them run across multiple machines...

Additional context

No response

Code of Conduct

  • I agree to follow this project's Code of Conduct

Metadata

Metadata

Labels

Idea 💡A new feature idea

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions