Skip to content

Revert "chore(test runner): remove fake skipped test results (#27762)"#28360

Merged
dgozman merged 1 commit intomicrosoft:mainfrom
dgozman:revert-210168e
Nov 28, 2023
Merged

Revert "chore(test runner): remove fake skipped test results (#27762)"#28360
dgozman merged 1 commit intomicrosoft:mainfrom
dgozman:revert-210168e

Conversation

@dgozman
Copy link
Contributor

@dgozman dgozman commented Nov 27, 2023

This reverts commit 210168e.

Fixes #28321.

@github-actions
Copy link
Contributor

Test results for "tests 1"

4 flaky ⚠️ [firefox] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [firefox] › page/frame-goto.spec.ts:46:3 › should continue after client redirect
⚠️ [playwright-test] › ui-mode-test-screencast.spec.ts:21:5 › should show screenshots
⚠️ [webkit] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks

26148 passed, 612 skipped
✔️✔️✔️

Merge workflow run.

@dgozman dgozman merged commit f61e445 into microsoft:main Nov 28, 2023
yury-s pushed a commit to yury-s/playwright that referenced this pull request Nov 28, 2023
dgozman added a commit that referenced this pull request Apr 25, 2024
There are plenty of edge cases in this area:
- interrupted test run;
- did not run because of serial mode failure;
- failed before `test.skip()` call (e.g. in `beforeEach`) in one of the
retries;
- and more...

Related issues: #28322, #28321, #27455, #17652.
Prior changes: #27762, #26385, #28360, probably more.

There is still some duplication between `outcome()` and similar logic in
`base.ts`, which might be deduped in a follow-up.

Fixes #28322.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[BUG] Ambiguous test outcome and status for serial mode

3 participants