Skip to content

Reuse E2E infrastructure for real device test#85

Merged
chrisgleissner merged 6 commits into
mainfrom
test/consolidat-e2e-tests
Jan 11, 2026
Merged

Reuse E2E infrastructure for real device test#85
chrisgleissner merged 6 commits into
mainfrom
test/consolidat-e2e-tests

Conversation

@chrisgleissner

Copy link
Copy Markdown
Owner

No description provided.

Copilot AI review requested due to automatic review settings January 11, 2026 10:51
@chrisgleissner chrisgleissner changed the title Consolidate E2E tests for both mocked and real device scenarios Reuse E2E infrastructure for real device test Jan 11, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This pull request removes two temporary tracking documents (PLANS.md and INVESTIGATIONS.md) from the repository root and updates .gitignore accordingly. Despite the PR title suggesting E2E test consolidation, the actual changes only involve documentation cleanup.

Changes:

  • Deleted PLANS.md (97 lines) containing a completed multi-hour task plan from 2026-01-11
  • Deleted INVESTIGATIONS.md (192 lines) containing resolved bug investigations
  • Updated .gitignore to remove references to deleted files and clean up duplicate entries

Reviewed changes

Copilot reviewed 2 out of 3 changed files in this pull request and generated no comments.

File Description
PLANS.md Removed completed task plan for fixing AV-sync test, packaging, and crash issues
INVESTIGATIONS.md Removed resolved investigations including UDP packet loss and real-device streaming issues
.gitignore Cleaned up entries for deleted files (PLANS.md, INVESTIGATIONS.md, build-docker.sh) and removed duplicate AGENTS.md entry

- Rename mocked scenario ntsc_default_debug → ntsc_default_avsync
- Add device-backed scenario ntsc_default_avsync_device (local-only, ci_skip)
- Extend E2E harness to support packet_source=device via WebSocket A/V sync toggle
- Remove legacy real-device runner scripts (real-device-av-sync.sh, real_device_av_sync.py)
- Remove --real-device flag from local-build.sh (replaced by unified E2E scenario)
- Add deterministic suite runner (tests/e2e/run_avsync_suite.sh)
- Update CI workflow to use renamed scenario, exclude device scenario
- Update docs for unified scenario + suite runner

Local validation: Mock scenario passed all assertions (4/4), device scenario
correctly requires real hardware (expected failure without device).
- Don’t treat low device packet sequences as mock data\n- Use av-sync.csv as authoritative A/V offset source\n- Wait for av-sync.csv to quiesce before teardown\n- Validate AV SYNC logs against av-sync.csv pop maxima when present
@chrisgleissner chrisgleissner merged commit 8552f4e into main Jan 11, 2026
11 checks passed
@chrisgleissner chrisgleissner deleted the test/consolidat-e2e-tests branch January 11, 2026 13:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants