Skip to content

chore(test runner): remove fake skipped test results#27762

Merged
dgozman merged 1 commit intomicrosoft:mainfrom
dgozman:tr-remove-fake-skipped-2
Oct 24, 2023
Merged

chore(test runner): remove fake skipped test results#27762
dgozman merged 1 commit intomicrosoft:mainfrom
dgozman:tr-remove-fake-skipped-2

Conversation

@dgozman
Copy link
Contributor

@dgozman dgozman commented Oct 23, 2023

Fixes #27455.

@github-actions
Copy link
Contributor

Test results for "tests 1"

9 flaky ⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › page/page-event-request.spec.ts:130:3 › should report navigation requests and responses handled by service worker with routing
⚠️ [chromium] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [firefox] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [chromium] › page/page-event-request.spec.ts:101:3 › should report navigation requests and responses handled by service worker
⚠️ [chromium] › components/splitView.spec.tsx:65:5 › drag resize
⚠️ [webkit] › library/tracing.spec.ts:239:5 › should not include trace resources from the previous chunks
⚠️ [webkit] › page/page-wait-for-navigation.spec.ts:85:3 › should work with clicking on links which do not commit navigation
⚠️ [playwright-test] › ui-mode-test-progress.spec.ts:167:5 › should update tracing network live

25959 passed, 603 skipped
✔️✔️✔️

Merge workflow run.

@dgozman dgozman merged commit 210168e into microsoft:main Oct 24, 2023
Germandrummer92 pushed a commit to OctoMind-dev/playwright that referenced this pull request Oct 27, 2023
pull bot pushed a commit to FANGOD/playwright that referenced this pull request Nov 28, 2023
yury-s pushed a commit to yury-s/playwright that referenced this pull request Nov 28, 2023
dgozman added a commit that referenced this pull request Apr 25, 2024
There are plenty of edge cases in this area:
- interrupted test run;
- did not run because of serial mode failure;
- failed before `test.skip()` call (e.g. in `beforeEach`) in one of the
retries;
- and more...

Related issues: #28322, #28321, #27455, #17652.
Prior changes: #27762, #26385, #28360, probably more.

There is still some duplication between `outcome()` and similar logic in
`base.ts`, which might be deduped in a follow-up.

Fixes #28322.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[BUG] Serial + Retry : Failed test is marked as flaky even if it never passes

2 participants