Overview

It is probable that I've encountered a bug related to execution of batch of tests.

If one of these test classes has a static method annotated with @BeforeEach, the whole batch is skipped.

Although the case with static method annotated with @BeforeEach is an error, it must not
ruin the rest of test plan.

Steps to Reproduce

The details are here: https://github.com/SqAutoTestTeam/possiblejunit5bug.git

Current behavior

• Error is written to log
• No tests in batch are executed

Expected behavior

• Error is still written to log
• Execute those test classes that are well-formed (have annotations over mwthods with right modifiers) and
• skip execution for those that are not.

Related Issues

• Introduce error handling mechanism for validation and discovery errors #242

Deliverables

• Ensure that configuration errors related to lifecycle methods (i.e., @BeforeAll, @AfterAll, @BeforeEach, @AfterEach) do not cause the entire test plan to abort prematurely.