Helix test results are not getting uploaded for a lot of jobs #74699
Description
For runtime pipeline, with rolling builds.
Working case in wasm/runtime-tests:
JIT.CodeGenBringUpTests.XUnitWrapper Total: 29, Errors: 0, Failed: 0, Skipped: 0, Time: 30.775s
+ export _commandExitCode=0
+ /usr/bin/python3 -u /datadisks/disk1/work/BB7B0A43/w/A9DB096A/u/xharness-event-processor.py
/usr/bin/python3: can't open file '/datadisks/disk1/work/BB7B0A43/w/A9DB096A/u/xharness-event-processor.py': [Errno 2] No such file or directory
+ /usr/bin/python3 /datadisks/disk1/work/BB7B0A43/p/reporter/run.py https://dev.azure.com/dnceng/ public 50501656 eyJ0eXAiOiJKV1 ....
2022-08-26T21:27:53.422Z INFO run.py run(48) main Beginning reading of test results.
2022-08-26T21:27:53.422Z INFO run.py __init__(42) read_results Searching '/datadisks/disk1/work/BB7B0A43/w/A9DB096A/e' for test results files
2022-08-26T21:27:53.422Z INFO run.py __init__(48) read_results Found results file /datadisks/disk1/work/BB7B0A43/w/A9DB096A/e/testResults.xml with format xunit
2022-08-26T21:27:53.427Z INFO run.py __init__(42) read_results Searching '/datadisks/disk1/work/BB7B0A43/w/A9DB096A/uploads' for test results files
2022-08-26T21:27:53.428Z INFO run.py packing_test_reporter(30) report_results Packing 29 test reports to '/datadisks/disk1/work/BB7B0A43/w/A9DB096A/e/__test_report.json'
2022-08-26T21:27:53.428Z INFO run.py packing_test_reporter(33) report_results Packed 7735 bytes
Broken cases
XHarness exit code: 0
C:\helix\work\workitem\e\wasm_build\AppBundle>set EXIT_CODE=0
----- end Fri 08/26/2022 21:54:44.42 ----- exit code 0 ----------------------------------------------------------
XHarness artifacts: C:\helix\work\workitem\uploads\xharness-output
python: can't open file 'C:\helix\work\workitem\u\xharness-event-processor.py': [Errno 2] No such file or directory
ERROR: The process "corerun.exe" not found.
[END EXECUTION]
Exit Code:0
XHarness exit code: 0
/datadisks/disk1/work/B24B0983/w/A9D4099F/e /datadisks/disk1/work/B24B0983/w/A9D4099F/e
----- end Fri Aug 26 21:08:51 UTC 2022 ----- exit code 0 ----------------------------------------------------------
XHarness artifacts: /datadisks/disk1/work/B24B0983/w/A9D4099F/uploads/xharness-output
+ export _commandExitCode=0
+ /usr/bin/python3 -u /datadisks/disk1/work/B24B0983/w/A9D4099F/u/xharness-event-processor.py
/usr/bin/python3: can't open file '/datadisks/disk1/work/B24B0983/w/A9D4099F/u/xharness-event-processor.py': [Errno 2] No such file or directory
+ exit 0
['normal-Microsoft.CSharp.Tests' END OF WORK ITEM LOG: Command exited with 0]
-
The above 2 cases are not running
reporter/run.py. The test results can't be seen via kusto. -
It seems to be working with this, but failing on the next rolling build. And the changes between those - 7b0227d...8755447 .
-
This is for wasm, rolling builds, and each column represents a different CI job:
Note: the xharness-event-processor.py error can be ignored.