feat: add junit xml and html test reports #1655

sgammon · 2025-09-21T01:24:36Z

Summary

Coming soon; supersedes #1652.

…put path

…ta class

Signed-off-by: Sam Gammon <sam@elide.dev>

codecov · 2025-09-21T03:27:34Z

Codecov Report

❌ Patch coverage is 73.93617% with 147 lines in your changes missing coverage. Please review.
✅ Project coverage is 40.59%. Comparing base (607eec2) to head (2924d3c).
⚠️ Report is 13 commits behind head on main.

Files with missing lines	Patch %	Lines
...lide/tooling/reporting/html/HtmlTemplateBuilder.kt	77.52%	40 Missing and 9 partials ⚠️
...lin/elide/tooling/reporting/html/HtmlTestModels.kt	70.77%	32 Missing and 13 partials ⚠️
...in/elide/tooling/reporting/xml/JUnitXmlReporter.kt	63.85%	21 Missing and 9 partials ⚠️
...otlin/elide/tooling/reporting/xml/JUnitXmlModel.kt	86.56%	9 Missing ⚠️
...elide/tooling/testing/TestPostProcessingOptions.kt	0.00%	5 Missing ⚠️
...lin/elide/tooling/reporting/TestReportProcessor.kt	85.71%	2 Missing and 1 partial ⚠️
...ain/kotlin/elide/tooling/runner/ElideTestRunner.kt	0.00%	3 Missing ⚠️
...n/elide/tooling/reporting/html/HtmlTestReporter.kt	75.00%	2 Missing ⚠️
...main/kotlin/elide/tooling/testing/TestRunResult.kt	0.00%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff            @@
##           main    #1655       +/-   ##
=========================================
+ Coverage      0   40.59%   +40.59%     
=========================================
  Files         0      797      +797     
  Lines         0    37795    +37795     
  Branches      0     5387     +5387     
=========================================
+ Hits          0    15344    +15344     
- Misses        0    20625    +20625     
- Partials      0     1826     +1826

Flag	Coverage Δ
jvm	`40.59% <73.93%> (?)`
lib	`40.59% <73.93%> (?)`

Flags with carried forward coverage won't be shown. Click here to find out more.

Files with missing lines	Coverage Δ
.../elide/tooling/coverage/CoverageReportProcessor.kt	`0.00% <ø> (ø)`
.../kotlin/elide/tooling/reporting/html/HtmlAssets.kt	`100.00% <100.00%> (ø)`
...main/kotlin/elide/tooling/testing/TestRunResult.kt	`0.00% <0.00%> (ø)`
...n/elide/tooling/reporting/html/HtmlTestReporter.kt	`75.00% <75.00%> (ø)`
...lin/elide/tooling/reporting/TestReportProcessor.kt	`89.28% <85.71%> (ø)`
...ain/kotlin/elide/tooling/runner/ElideTestRunner.kt	`0.00% <0.00%> (ø)`
...elide/tooling/testing/TestPostProcessingOptions.kt	`0.00% <0.00%> (ø)`
...otlin/elide/tooling/reporting/xml/JUnitXmlModel.kt	`86.56% <86.56%> (ø)`
...in/elide/tooling/reporting/xml/JUnitXmlReporter.kt	`63.85% <63.85%> (ø)`
...lin/elide/tooling/reporting/html/HtmlTestModels.kt	`70.77% <70.77%> (ø)`
... and 1 more

... and 786 files with indirect coverage changes

Continue to review full report in Codecov by Sentry.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 607eec2...2924d3c. Read the comment docs.

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Copilot

Pull Request Overview

This PR adds test reporting capabilities to the Elide tooling framework by implementing both JUnit XML and HTML test report generation. The implementation supports converting Elide test results into standard formats that can be consumed by CI/CD systems, IDEs, and test reporting tools.

Key changes:

Extended test data structures to include individual test results alongside aggregate statistics
Implemented JUnit XML reporter with proper data model and formatting
Created interactive HTML reporter with search, filtering, and collapsible sections

Reviewed Changes

Copilot reviewed 14 out of 15 changed files in this pull request and generated 5 comments.

Show a summary per file

File	Description
TestRunResult.kt	Added testResults property to include individual test case results
TestPostProcessor.kt	Updated interface documentation and method signature formatting
TestPostProcessingOptions.kt	Added report format, output path, and suite name configuration options
TestReportProcessorTest.kt	Comprehensive test suite for both XML and HTML report generation
ElideTestRunner.kt	Modified to collect individual test results for reporting
JUnitXmlReporter.kt	Core XML report generation logic with JUnit format compliance
JUnitXmlModel.kt	Data models for JUnit XML structure with Jackson annotations
HtmlTestReporter.kt	HTML report generator using kotlinx-html DSL
HtmlTestModels.kt	Data models and conversion logic for HTML reports
HtmlTemplateBuilder.kt	HTML template generation with embedded CSS and JavaScript
HtmlAssets.kt	Embedded CSS and JavaScript assets for interactive features
TestReportProcessor.kt	Main processor implementation with format switching
build.gradle.kts	Added Jackson XML dependencies
elide.versions.toml	Added jackson-dataformat-xml dependency version

_{Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.}

packages/tooling/src/main/kotlin/elide/tooling/testing/TestPostProcessingOptions.kt

packages/builder/src/test/kotlin/elide/tooling/reporting/TestReportProcessorTest.kt

packages/builder/src/main/kotlin/elide/tooling/reporting/html/HtmlTemplateBuilder.kt

packages/builder/src/main/kotlin/elide/tooling/reporting/html/HtmlAssets.kt

sgammon added this to the Release R18: Beta milestone Sep 21, 2025

sgammon self-assigned this Sep 21, 2025

sgammon added feature Large PRs or issues with full-blown features tools:test-runner Stuff relating to Elide's test runner labels Sep 21, 2025

sgammon added this to Elide Sep 21, 2025

sgammon moved this to In Progress in Elide Sep 21, 2025

sgammon linked an issue Sep 21, 2025 that may be closed by this pull request

Test Runner: Test Reporting #1483

Closed

2 tasks

franklinfollis and others added 11 commits September 20, 2025 18:25

feat(test-reporting): add JUnit XML test report implementation

36c40ff

fix(test-reporting): detekt errors

90352be

fix(test-reporting): explicit check for stdout and stderr in XML output

65ec8ee

feat(test-reporting): add extra options for specifying format and out…

542993e

…put path

feat(test-reporting): initial html test reporting assets and structure

a53658b

feat(test-reporting): generate html report in test post processor

ce3a2d2

feat(test-reporting): add tests for html test report output

565706e

feat(test-reporting): aggregate individual test results

c2d5d1f

feat(test-reporting): migrate test reporters to use new TestResult da…

be501fa

…ta class

fix(test-reporting): rename testResults property

1fea687

chore: nitfixes (formatting, line length, detekt)

9eff1ce

Signed-off-by: Sam Gammon <sam@elide.dev>

sgammon force-pushed the feat/test-reporting-runner-v2 branch from 5cca244 to 9eff1ce Compare September 21, 2025 01:25

sgammon added 2 commits September 20, 2025 18:43

fix: deprecated call to xml mapper

89dbc68

Signed-off-by: Sam Gammon <sam@elide.dev>

chore: spotless fmt

2924d3c

Signed-off-by: Sam Gammon <sam@elide.dev>

sgammon changed the title ~~[WIP] feat: add junit xml and html test reports~~ feat: add junit xml and html test reports Sep 21, 2025

sgammon marked this pull request as ready for review September 21, 2025 03:35

sgammon requested review from a team and Copilot September 21, 2025 03:40

Copilot AI reviewed Sep 21, 2025

View reviewed changes

sgammon merged commit 70b65a5 into main Sep 21, 2025
18 checks passed

github-project-automation bot moved this from In Progress to Done in Elide Sep 21, 2025

sgammon mentioned this pull request Sep 21, 2025

release: 1.0.0-beta9 #1657

Merged

31 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

feat: add junit xml and html test reports #1655

feat: add junit xml and html test reports #1655

Uh oh!

sgammon commented Sep 21, 2025 •

edited by pull-request-badge bot

Loading

Uh oh!

codecov bot commented Sep 21, 2025 •

edited

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

feat: add junit xml and html test reports #1655

feat: add junit xml and html test reports #1655

Uh oh!

Conversation

sgammon commented Sep 21, 2025 • edited by pull-request-badge bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Uh oh!

codecov bot commented Sep 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull Request Overview

Reviewed Changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

sgammon commented Sep 21, 2025 •

edited by pull-request-badge bot

Loading

codecov bot commented Sep 21, 2025 •

edited

Loading