Skip to content

Enable mutation testing#4026

Closed
barbulescu wants to merge 1 commit into
assertj:mainfrom
barbulescu:mutation-testing
Closed

Enable mutation testing#4026
barbulescu wants to merge 1 commit into
assertj:mainfrom
barbulescu:mutation-testing

Conversation

@barbulescu

@barbulescu barbulescu commented Nov 22, 2025 •
edited by scordio
Loading

Copy link
Copy Markdown

@scordio scordio added the event: Hack.Commit.Push A topic worked on during a Hack.Commit.Push event label Nov 22, 2025
@scordio scordio self-assigned this Nov 22, 2025
@joel-costigliola

joel-costigliola commented Nov 22, 2025

Copy link
Copy Markdown
Member

related to #3843, we should use arcmutate license for this

@barbulescu

barbulescu commented Nov 22, 2025

Copy link
Copy Markdown
Author

related to #3843, we should use arcmutate license for this

License is located in correct folder as per https://docs.arcmutate.com/docs/licence-management.html#licence-locations.

Is anything else to be configured?

@barbulescu

barbulescu commented Nov 22, 2025

Copy link
Copy Markdown
Author 
./mvnw -Ppitest test

[ERROR] Failed to execute goal org.pitest:pitest-maven:1.22.0:mutationCoverage (pitest) on project assertj-core: Mutation score of 72 is below threshold of 90 -> [Help 1]

@barbulescu

barbulescu commented Nov 22, 2025

Copy link
Copy Markdown
Author
pit-report [pit-reports.zip](https://github.com/user-attachments/files/23689962/pit-reports.zip)

@barbulescu barbulescu marked this pull request as ready for review November 22, 2025 15:32
@scordio

scordio commented Nov 22, 2025

Copy link
Copy Markdown
Member

As briefly discussed, it might be interesting to see how other projects like EqualsVerifier handle the data baseline.

@barbulescu barbulescu marked this pull request as draft November 22, 2025 15:48
@barbulescu

barbulescu commented Nov 22, 2025

Copy link
Copy Markdown
Author

I will add also support for CI and then I will re-open for review.

@barbulescu barbulescu marked this pull request as ready for review May 15, 2026 04:52
@barbulescu barbulescu marked this pull request as draft May 15, 2026 04:54
@barbulescu

barbulescu commented May 15, 2026

Copy link
Copy Markdown
Author

Some tests are failing without mutation - I will exclude for now:

6:59:08 AM PIT >> SEVERE : Tests failing without mutation: 
Description [testClass=org.assertj.core.util.Throwables_describeErrors_Test, name=[engine:junit-jupiter]/[class:org.assertj.core.util.Throwables_describeErrors_Test]/[method:should_honor_maxStackTraceElementsDisplayed_setting_when_exception_has_no_cause()]]
Description [testClass=org.example.test.AutoClosableSoftAssertionsLineNumberTest, name=[engine:junit-jupiter]/[class:org.example.test.AutoClosableSoftAssertionsLineNumberTest]/[method:should_print_line_numbers_of_failed_assertions()]]
Description [testClass=org.example.test.BDDSoftAssertionsLineNumberTest, name=[engine:junit-jupiter]/[class:org.example.test.BDDSoftAssertionsLineNumberTest]/[method:should_print_line_numbers_of_failed_assertions()]]
Description [testClass=org.example.test.MultipleAssertionsError_getMessage_Test, name=[engine:junit-jupiter]/[class:org.example.test.MultipleAssertionsError_getMessage_Test]/[method:should_show_object_under_test()]]
Description [testClass=org.example.test.MultipleAssertionsError_getMessage_Test, name=[engine:junit-jupiter]/[class:org.example.test.MultipleAssertionsError_getMessage_Test]/[method:should_show_description_and_object_under_test()]]
Description [testClass=org.example.test.MultipleAssertionsError_getMessage_Test, name=[engine:junit-jupiter]/[class:org.example.test.MultipleAssertionsError_getMessage_Test]/[method:should_include_errors_count_and_allow_to_navigate_to_the_failing_soft_assertion_line()]]
Description [testClass=org.example.test.MultipleAssertionsError_getMessage_Test, name=[engine:junit-jupiter]/[class:org.example.test.MultipleAssertionsError_getMessage_Test]/[method:should_honor_description()]]
Description [testClass=org.example.test.SoftAssertionsLineNumberTest, name=[engine:junit-jupiter]/[class:org.example.test.SoftAssertionsLineNumberTest]/[method:should_print_line_numbers_of_failed_assertions_even_if_it_came_from_nested_calls()]]
Description [testClass=org.example.test.SoftAssertionsLineNumberTest, name=[engine:junit-jupiter]/[class:org.example.test.SoftAssertionsLineNumberTest]/[method:should_print_line_numbers_of_failed_assertions()]]

@barbulescu barbulescu marked this pull request as ready for review May 15, 2026 05:09
@scordio scordio changed the base branch from main to 3.x June 5, 2026 07:56
@scordio scordio changed the base branch from 3.x to main June 5, 2026 07:56
@testlens-app

testlens-app Bot commented Jun 5, 2026

Copy link
Copy Markdown

✅ All tests passed ✅

🏷️ Commit: 9f5edd3
▶️ Tests: 54381 executed
⚪️ Checks: 17/17 completed

Learn more about TestLens at testlens.app.

@barbulescu
add mutation testing
a455298 
update excluded test classes for mutation testing
@barbulescu barbulescu mentioned this pull request Jun 5, 2026
Closed
@scordio

scordio commented Jun 5, 2026

Copy link
Copy Markdown
Member

Superseded by #4275.

@scordio scordio closed this Jun 5, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

@scordio scordio

Labels

event: Hack.Commit.Push A topic worked on during a Hack.Commit.Push event

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@barbulescu @joel-costigliola @scordio