Skip to content

Optimize E2E tests by replacing HTTP dependencies with shell/hello actions#148

Merged
linyows merged 3 commits intomainfrom
optimize-e2e-tests-remove-http-deps
Jan 13, 2026
Merged

Optimize E2E tests by replacing HTTP dependencies with shell/hello actions#148
linyows merged 3 commits intomainfrom
optimize-e2e-tests-remove-http-deps

Conversation

@linyows
Copy link
Owner

@linyows linyows commented Jan 13, 2026

Summary

This PR optimizes E2E test execution time by replacing HTTP action dependencies with shell/hello actions in example files that don't specifically test HTTP functionality.

Changes

Example Files (8 files)

  • truncate-print.yml: Use shell to generate long output instead of HTTP response
  • outputs-literal.yml: Use shell for outputs functionality testing
  • yaml-alias.yml + yaml-shared.yml: Use shell for YAML alias testing
  • nested-alias.yml: Use shell for nested YAML alias testing
  • iteration-literal.yml: Use shell for iteration functionality
  • repeat-literal.yml: Replace HTTP step with shell
  • embedded-job.yml + dev.yml: Replace HTTP step with shell
  • expr-functions.yml: Use vars for JSON match testing instead of HTTP response

Test Configuration

  • testdata/verify-examples.yml:
    • Moved 8 tests from "HTTP Workflow Tests" to "Basic Workflow Tests"
    • These tests no longer require HTTP server startup (saves ~6.5s wait time)
    • "HTTP Workflow Tests" now only contains http.yml (the actual HTTP action test)

Benefits

  • Faster test execution: 8 tests no longer wait for HTTP server startup (~6.5s)
  • Better test isolation: Tests for non-HTTP features don't depend on HTTP server
  • Clearer test intent: Each test focuses on the feature it's actually testing

Test Results

All E2E tests pass successfully:

Total workflow time: 122.69s ✓ All jobs succeeded

🤖 Generated with Claude Code

…tions

Replace HTTP action with shell/hello action in 8 example files to reduce
test execution time by eliminating HTTP server startup wait time.

Changes:
- truncate-print.yml: Use shell to generate long output
- outputs-literal.yml: Use shell for outputs functionality testing
- yaml-alias.yml + yaml-shared.yml: Use shell for YAML alias testing
- nested-alias.yml: Use shell for nested YAML alias testing
- iteration-literal.yml: Use shell for iteration functionality
- repeat-literal.yml: Replace HTTP step with shell
- embedded-job.yml + dev.yml: Replace HTTP step with shell
- expr-functions.yml: Use vars for JSON match testing

testdata/verify-examples.yml:
- Move 8 tests from "HTTP Workflow Tests" to "Basic Workflow Tests"
- These tests no longer require HTTP server startup (saves ~6.5s)
- HTTP Workflow Tests now only contains http.yml (actual HTTP action test)

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>
@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

@github-actions

This comment has been minimized.

1 similar comment
@github-actions
Copy link

Code Metrics Report

main (7bb4fde) #148 (311ae3d) +/-
Coverage 48.7% 48.7% -0.1%
Code to Test Ratio 1:1.1 1:1.1 0.0
Test Execution Time 1m27s 23s -1m4s
Details
  |                     | main (7bb4fde) | #148 (311ae3d) |  +/-  |
  |---------------------|----------------|----------------|-------|
- | Coverage            |          48.7% |          48.7% | -0.1% |
  |   Files             |             52 |             52 |     0 |
  |   Lines             |           5249 |           5249 |     0 |
- |   Covered           |           2561 |           2560 |    -1 |
  | Code to Test Ratio  |          1:1.1 |          1:1.1 |   0.0 |
  |   Code              |          10573 |          10573 |     0 |
  |   Test              |          12109 |          12109 |     0 |
+ | Test Execution Time |          1m27s |            23s | -1m4s |

Code coverage of files in pull request scope (73.1% → 72.0%)

Files Coverage +/- Status
mail/mock_server.go 72.0% -1.1% affected

Reported by octocov

@linyows linyows merged commit 952fea7 into main Jan 13, 2026
7 checks passed
@linyows linyows deleted the optimize-e2e-tests-remove-http-deps branch January 13, 2026 07:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant