Since June 24 we noticed many failures for runtime tests:

Example build https://dev.azure.com/dnceng/public/_build/results?buildId=1208782&view=logs&j=1fbc174f-133f-57a8-dcec-0de15ad033b4&t=a697e205-a0a3-5096-6a0a-07ceb96d569b

It might be related to XHarness or Arcade update between https://dev.azure.com/dnceng/public/_build/results?buildId=1203823&view=results and https://dev.azure.com/dnceng/public/_build/results?buildId=1203693&view=results