Skip to content

Change update_deps script so that latest stable version can be pulled instead of latest nightly#9424

Merged
qihqi merged 4 commits intomasterfrom
bfolie/pin-update-stable
Jul 7, 2025
Merged

Change update_deps script so that latest stable version can be pulled instead of latest nightly#9424
qihqi merged 4 commits intomasterfrom
bfolie/pin-update-stable

Conversation

@bfolie
Copy link
Copy Markdown
Collaborator

@bfolie bfolie commented Jun 30, 2025

Given the decision to sync with a stable release, modifies the update_deps.py script to optionally determine the latest release of Jax and get the corresponding openxla hash and libtpu version.

Running the script changes the XLA hash from 9084478 to 3d5ece6. The latter is the XLA commit pinned by Jax 0.6.2, which is what we want. The former was the last commit on the day of the release. In this case they both work, but it's a nice verification that this script can get us a more compatible version with less effort.

Note that setup.py has a USE_NIGHTLY bool which, if False, will pull jax and jaxlib using their version numbers instead of pulling the corresponding nightly from the package registries. This seems like a change we want to make but doing so in this case fails with

ImportError: /home/runner/.local/lib/python3.10/site-packages/_XLAC.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZNK3c1010TensorImpl35is_non_overlapping_and_dense_customEv

This failure is because we are missing symbol sym_is_non_overlapping_and_dense_custom, introduced a few days ago here. So we're using an older, stable version of pytorch. I don't understand why this is the case, based on setup.py. But in the meantime I keep USE_NIGHTLY as True. This means we're still technically pulling a nightly version, but it's the nightly built from the most recent stable Jax version.

@bfolie bfolie changed the title Change update_deps script so that latest stable version can be pulled instead of nightly Change update_deps script so that latest stable version can be pulled instead of latest nightly Jun 30, 2025
@qihqi qihqi merged commit 66ad14f into master Jul 7, 2025
23 of 24 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants