Highlights

• TPU Support in GKE ndoepool module with example blueprint
• Support for Managed Lustre in pre-existing-network-storage module; Managed Lustre provisioning will be supported in a future Toolkit release

What's Changed

Key New Features 🎉

• add nvidia imex support by @ighosh98 in add nvidia imex support #3885
• TPU support with GKE nodepool module and TPU v4 2x2x2 example blueprint by @SwarnaBharathiMantena in TPU support with GKE nodepool module and TPU v4 2x2x2 example blueprint #3817
• helm_install module implemented by @ighosh98 in helm_install module implemented #3933
• integrate support for multi-arch compliant jobset v0.8.1 by @ighosh98 in integrate support for multi-arch compliant jobset v0.8.1 #3934
• Update vm-instance to support additional persistent disks by @tpdownes in Update vm-instance to support additional persistent disks #3935
• add support for workload policy by @ighosh98 in add support for workload policy #3938

Breaking Changes 🚨

• Make login nodes deployable independently of "controller" by @mr0re1 in Make login nodes deployable independently of "controller" #3958
  NOTE: Attempt to re-deploy pre-existing Slurm cluster with new gcluster version will cause login nodes to be destroyed.
• DWS Flex Implementation will change with this release, if you would like to continue using the legacy implementation we've add use_bulk_insert options to our dws_flex nodeset settings. For more on DWS Flex support in Slurm visit: https://github.com/GoogleCloudPlatform/cluster-toolkit/blob/main/docs/slurm-dws-flex.md

New Modules 🧱

• Adding Managed Lustre to Cluster Toolkit by @cdunbar13 in Adding Managed Lustre to Cluster Toolkit #3950

Module Improvements 🔨

• [GKE] Add support to enable DNS based endpoint config by @mohitchaurasia91 in [GKE] Add support to enable DNS based endpoint config #3884
• Update filestore timeout config based on high capacity tier by @mohitchaurasia91 in Update filestore timeout config based on high capacity tier #3900
• split terraform bundles for gpu operator by @ighosh98 in split terraform bundles for gpu operator #3911
• split crd manifest out by @ighosh98 in split crd manifest out #3913
• Add support for filestore instance description by @mohitchaurasia91 in Add support for filestore instance description #3953
• Fix Packer documentation for minimum necessary IAM roles by @tpdownes in Fix Packer documentation for minimum necessary IAM roles #3960
• Fix workload_policy varible definition and usage. by @mohitchaurasia91 in Fix workload_policy varible definition and usage. #3963
• Add Managed Lustre to pre-existing-filestore module by @cdunbar13 in Add Managed Lustre to pre-existing-filestore module #3937

Improvements 🛠

• Update GKE version prefix for A3 Mega to v1.32.2 by @ighosh98 in Update GKE version prefix for A3 Mega to v1.32.2 #3874
• Add disk size vars for A4 by @parulbajaj01 in Add disk size vars for A4 #3872
• Add comment description for variables in a4 blueprint by @parulbajaj01 in Add comment description for variables in a4 blueprint #3880
• Add kueue configuration support to a3 mega by @ighosh98 in Add kueue configuration support to a3 mega #3860
• Update dra driver module by @ighosh98 in Update dra driver module #3894
• Add MIG based DWS Flex support by @abbas1902 in Add MIG based DWS Flex support #3903
• A4 Slurm: enable sudo in Slurm jobs for users with OS Admin Login role by @tpdownes in A4 Slurm: enable sudo in Slurm jobs for users with OS Admin Login role #3961
• Add sudo via OS Login to all A3 Slurm solutions by @RachaelSTamakloe in Add sudo via OS Login to all A3 Slurm solutions #3966

Version Updates ⏫

• Bump golang versions (1.22, 1.23) -> (1.23, 1.24) by @mr0re1 in Bump golang versions (1.22, 1.23) -> (1.23, 1.24) #3923

Bug fixes 🐞

• Fix filestore instance location var for REGIONAL tier by @mohitchaurasia91 in Fix filestore instance location var for REGIONAL tier #3871
• add GCS updates to A3 Ultra by @ighosh98 in add GCS updates to A3 Ultra #3883
• GPU Operator Integration Redesign by @ighosh98 in GPU Operator Integration Redesign #3892
• Add resource quota for gpu operator by @ighosh98 in Add resource quota for gpu operator #3895
• Update imex and nvidia DRA Driver configurations by @ighosh98 in Update imex and nvidia DRA Driver configurations #3902
• Update nccl installer for a4 by @ighosh98 in Update nccl installer for a4 #3906
• Fix syntax errors for resource policy by @ighosh98 in Fix syntax errors for resource policy #3954
• Revert network profile URI by @cdunbar13 in Revert network profile URI #3962

Full Changelog: v1.48.1...v1.49.0