Skip to content

[BE] Upgrade XPU support package to 2025.1 in CICD#151899

Closed
chuanqi129 wants to merge 1 commit intopytorch:mainfrom
chuanqi129:xpu_2025_1
Closed

[BE] Upgrade XPU support package to 2025.1 in CICD#151899
chuanqi129 wants to merge 1 commit intopytorch:mainfrom
chuanqi129:xpu_2025_1

Conversation

@chuanqi129
Copy link
Collaborator

@chuanqi129 chuanqi129 commented Apr 22, 2025

Address #151097. Including below changes,

  • Add XPU support package 2025.1 build and test in CI for both Linux and Windows
  • Keep XPU support package 2025.0 build in CI to ensure no break issue until PyTorch 2.8 release
  • Upgrade XPU support package from 2025.0 to 2025.1 in CD for both Linux and Windows
  • Enable XCCL in Linux CD wheel and oneMKL integration in both both Linux and Windows
  • Update XPU runtime pypi packages of CD wheels
  • Remove deprecated support package version docker image build

@pytorch-bot
Copy link

pytorch-bot bot commented Apr 22, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/151899

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

✅ No Failures

As of commit e5ac494 with merge base 032ef48 (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@pytorch-bot pytorch-bot bot added the release notes: releng release notes category label Apr 22, 2025
@chuanqi129 chuanqi129 added topic: not user facing topic category ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR ciflow/xpu Run XPU CI tasks labels Apr 22, 2025
@pytorch-bot pytorch-bot bot removed ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR ciflow/xpu Run XPU CI tasks labels Apr 22, 2025
@chuanqi129 chuanqi129 added ciflow/xpu Run XPU CI tasks ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR labels Apr 22, 2025
@pytorch-bot pytorch-bot bot removed ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR ciflow/xpu Run XPU CI tasks labels Apr 24, 2025
@chuanqi129 chuanqi129 added the ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR label Apr 24, 2025
@pytorch-bot
Copy link

pytorch-bot bot commented Apr 24, 2025

To add the ciflow label ciflow/binaries_wheel please first approve the workflows that are awaiting approval (scroll to the bottom of this page).

This helps ensure we don't trigger CI on this PR until it is actually authorized to do so. Please ping one of the reviewers if you do not have access to approve and run workflows.

@pytorch-bot pytorch-bot bot removed the ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR label Apr 24, 2025
@chuanqi129 chuanqi129 added the ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR label Apr 24, 2025
@pytorch-bot pytorch-bot bot removed the ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR label Apr 24, 2025
@chuanqi129 chuanqi129 requested a review from atalman April 24, 2025 09:22
@chuanqi129 chuanqi129 added the ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR label Apr 24, 2025
@pytorch-bot pytorch-bot bot removed the ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR label May 5, 2025
@chuanqi129 chuanqi129 added ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR ciflow/xpu Run XPU CI tasks labels May 5, 2025
@chuanqi129 chuanqi129 added the ciflow/xpu Run XPU CI tasks label May 9, 2025
@pytorch-bot pytorch-bot bot removed ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR ciflow/xpu Run XPU CI tasks labels May 12, 2025
@chuanqi129 chuanqi129 added ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR ciflow/xpu Run XPU CI tasks labels May 12, 2025
@EikanWang EikanWang requested a review from Copilot May 12, 2025 14:10
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR upgrades the XPU support package to version 2025.1 across various CICD configurations. Key changes include:

  • Updating Linux and Windows build and test workflows to reference XPU 2025.1.
  • Revising PYTORCH_EXTRA_INSTALL_REQUIREMENTS in multiple workflows to use version 2025.1.1.
  • Removing deprecated support package version docker image build entries.

Reviewed Changes

Copilot reviewed 6 out of 14 changed files in this pull request and generated no comments.

Show a summary per file
File Description
.github/workflows/xpu.yml Updated job identifiers, environment variables, and sync tags to use XPU 2025.1 specifications.
.github/workflows/pull.yml Updated workflow job names and sync-tag for XPU builds; minor inconsistencies remain in build params.
.github/workflows/generated-windows-binary-wheel-nightly.yml Revised extra install requirements to incorporate the new XPU package version for Windows CI.
.github/workflows/generated-linux-binary-manywheel-nightly.yml Revised extra install requirements to incorporate the new XPU package version for Linux manywheel CI.
.github/workflows/docker-builds.yml Replaced deprecated docker image build entry with the updated XPU version.
.github/scripts/generate_binary_build_matrix.py Updated build matrix strings to reference the new XPU package version.
Files not reviewed (8)
  • .ci/docker/build.sh: Language not supported
  • .ci/docker/common/install_xpu.sh: Language not supported
  • .ci/docker/manywheel/Dockerfile_2_28: Language not supported
  • .ci/manywheel/build_xpu.sh: Language not supported
  • .ci/pytorch/windows/internal/xpu_install.bat: Language not supported
  • .ci/pytorch/windows/xpu.bat: Language not supported
  • .circleci/scripts/binary_windows_build.sh: Language not supported
  • .circleci/scripts/binary_windows_test.sh: Language not supported
Comments suppressed due to low confidence (2)

.github/workflows/pull.yml:541

  • The build-environment is still set to linux-jammy-xpu-2025.0-py3.9; please update it to linux-jammy-xpu-2025.1-py3.9 for consistency with the new support package version.
build-environment: linux-jammy-xpu-2025.0-py3.9

.github/workflows/pull.yml:542

  • The docker-image-name is still referencing version 2025.0; please update it to ci-image:pytorch-linux-jammy-xpu-2025.1-py3 to match the intended upgrade.
docker-image-name: ci-image:pytorch-linux-jammy-xpu-2025.0-py3

@pytorch-bot pytorch-bot bot removed ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR ciflow/xpu Run XPU CI tasks labels May 12, 2025
@chuanqi129 chuanqi129 added ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR ciflow/xpu Run XPU CI tasks ciflow/trunk Trigger trunk jobs on your pull request labels May 12, 2025
Comment on lines +95 to +97
"oneccl-devel==2021.15.1; platform_system == 'Linux' and platform_machine == 'x86_64' | "
"oneccl==2021.15.1; platform_system == 'Linux' and platform_machine == 'x86_64' | "
"impi-rt==2021.15.0; platform_system == 'Linux' and platform_machine == 'x86_64' | "
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For reviewers' information - the three packages are dedicated to Intel Communication Collective Libraries for Distributed. Currently, Intel GPU only plans to support Linux.

Copy link
Contributor

@atalman atalman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@atalman
Copy link
Contributor

atalman commented May 14, 2025

@pytorchmergebot merge -i

@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged while ignoring the following 0 checks:

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR ciflow/trunk Trigger trunk jobs on your pull request ciflow/xpu Run XPU CI tasks Merged open source release notes: releng release notes category topic: not user facing topic category

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants