Update Simulator.Commands Helix queue from osx.13 to osx.15#1545
Merged
matouskozak merged 5 commits intomainfrom Mar 10, 2026
Merged
Update Simulator.Commands Helix queue from osx.13 to osx.15#1545matouskozak merged 5 commits intomainfrom
matouskozak merged 5 commits intomainfrom
Conversation
The Simulator.Commands.Tests.proj was using osx.13.amd64.open (macOS Ventura 13) which is the oldest queue. Update to osx.15.amd64.open to align with the other Apple simulator test projects and dotnet/runtime. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
The osx.15 machines have iOS 18.1 pre-installed. The old 16.4 version required downloading a 6.18 GB simulator runtime, causing timeouts. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
matouskozak
approved these changes
Feb 27, 2026
3 tasks
The non-architecture-specific app bundle (from June 2025) fails to launch on iOS 18.1 simulators. Update the download URL to use the x64-specific path which has a newer app bundle (December 2025) that is compatible. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
…ds E2E test The manual 'install' + 'just-test' flow has a systematic failure on iOS 18.1 simulators (APP_LAUNCH_FAILURE). The 'apple test' command, which handles the full lifecycle internally, works correctly on the same platform. This change replaces the failing flow while still exercising 5 manual commands: simulators install, reset-simulator, device, test (with --device), and uninstall. The 'just-test' failure on iOS 18.1 should be investigated separately. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
The 'apple test' command shuts down the simulator during cleanup, which causes the subsequent 'apple uninstall' to fail with PACKAGE_NOT_FOUND. The uninstall is still executed to exercise the command, but its exit code no longer affects the test result. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
8 tasks
Member
|
@vitek-karas is this ready to merge? |
Member
Author
|
I reviewed it again - and I think it's good to merge. |
matouskozak
approved these changes
Mar 10, 2026
Member
Author
|
@matouskozak @kotlarmilos - we will likely need to backport this to release/net10 branch as well, what do you think? |
Member
I think we're currently serving all runtime servicing branches from the main of dotnet/xharness. We can backport this in a case we want to go back to using xharness servicing branches again (now or in the future). |
matouskozak
pushed a commit
to matouskozak/xharness
that referenced
this pull request
Mar 11, 2026
) * Update Simulator.Commands Helix queue from osx.13 to osx.15 The Simulator.Commands.Tests.proj was using osx.13.amd64.open (macOS Ventura 13) which is the oldest queue. Update to osx.15.amd64.open to align with the other Apple simulator test projects and dotnet/runtime. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * Update iOS simulator version to 18.1 for osx.15 queue The osx.15 machines have iOS 18.1 pre-installed. The old 16.4 version required downloading a 6.18 GB simulator runtime, causing timeouts. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * Use architecture-specific test app bundle for simulator commands test The non-architecture-specific app bundle (from June 2025) fails to launch on iOS 18.1 simulators. Update the download URL to use the x64-specific path which has a newer app bundle (December 2025) that is compatible. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * Use 'apple test' instead of 'install + just-test' in Simulator Commands E2E test The manual 'install' + 'just-test' flow has a systematic failure on iOS 18.1 simulators (APP_LAUNCH_FAILURE). The 'apple test' command, which handles the full lifecycle internally, works correctly on the same platform. This change replaces the failing flow while still exercising 5 manual commands: simulators install, reset-simulator, device, test (with --device), and uninstall. The 'just-test' failure on iOS 18.1 should be investigated separately. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> * Don't fail test on uninstall after 'apple test' cleanup The 'apple test' command shuts down the simulator during cleanup, which causes the subsequent 'apple uninstall' to fail with PACKAGE_NOT_FOUND. The uninstall is still executed to exercise the command, but its exit code no longer affects the test result. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> --------- Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The Simulator.Commands.Tests.proj was using
osx.13.amd64.open(macOS Ventura 13) which is the oldest macOS Helix queue. All other Apple simulator test projects in this repo already useosx.15.amd64.open, and dotnet/runtime also uses osx.15 as their baseline for simulator testing.This updates the queue to
osx.15.amd64.opento align with the rest of the repo and dotnet/runtime.