Skip to content

Commit 2a60ac9

Browse files
emricksini-hemricksini-h
authored
[Improvement] Persist CUDA compat libraries paths to prevent reset on apt-get (vllm-project#30784)
Signed-off-by: emricksini-h <emrick.birivoutin@hcompany.ai>
1 parent 9e65bb4 commit 2a60ac9

1 file changed

Lines changed: 4 additions & 4 deletions

File tree

‎docker/Dockerfile‎

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -117,8 +117,8 @@ ENV UV_LINK_MODE=copy
117117
# Verify GCC version
118118
RUN gcc --version
119119

120-
# Workaround for triton/pytorch issues
121-
RUN ldconfig /usr/local/cuda-$(echo $CUDA_VERSION | cut -d. -f1,2)/compat/
120+
# Ensure CUDA compatibility library is loaded
121+
RUN echo "/usr/local/cuda-$(echo "$CUDA_VERSION" | cut -d. -f1,2)/compat/" > /etc/ld.so.conf.d/00-cuda-compat.conf && ldconfig
122122

123123
# ============================================================
124124
# SLOW-CHANGING DEPENDENCIES BELOW
@@ -453,8 +453,8 @@ ENV UV_HTTP_TIMEOUT=500
453453
ENV UV_INDEX_STRATEGY="unsafe-best-match"
454454
ENV UV_LINK_MODE=copy
455455

456-
# Workaround for triton/pytorch issues
457-
RUN ldconfig /usr/local/cuda-$(echo $CUDA_VERSION | cut -d. -f1,2)/compat/
456+
# Ensure CUDA compatibility library is loaded
457+
RUN echo "/usr/local/cuda-$(echo "$CUDA_VERSION" | cut -d. -f1,2)/compat/" > /etc/ld.so.conf.d/00-cuda-compat.conf && ldconfig
458458

459459
# ============================================================
460460
# SLOW-CHANGING DEPENDENCIES BELOW

0 commit comments

Comments
 (0)