Skip to content

Use host CUDA version for all CSV compat checks#1679

Merged
elezar merged 1 commit intoNVIDIA:mainfrom
elezar:update-cuda-compat
Feb 25, 2026
Merged

Use host CUDA version for all CSV compat checks#1679
elezar merged 1 commit intoNVIDIA:mainfrom
elezar:update-cuda-compat

Conversation

@elezar
Copy link
Member

@elezar elezar commented Feb 25, 2026

The host driver version returned on nvgpu (e.g. Thor) systems is unreliable in terms of determining whether CUDA compat should be used. Even though the "standard" compat libraries are used, we should still only consider the host CUDA version and not the host driver versions.

Running on a Thor-based system:

CUDA error at /usr/samples/Samples/0_Introduction/simpleStreams/../../../Common/helper_cuda.h:816 code=803(cudaErrorSystemDriverMismatch) "cudaGetDeviceCount(&device_count)"

Note that:

 ldconfig -p | grep libcuda.so.1
	libcuda.so.1 (libc6,AArch64) => /usr/local/cuda-13.0/compat/libcuda.so.1
	libcuda.so.1 (libc6,AArch64) => /usr/lib/aarch64-linux-gnu/nvidia/libcuda.so.1

After removing the compat libraries:

$ rm /etc/ld.so.conf.d/00-compat-888138641.conf && ldconfig
root@localhost:/usr/samples/Samples/0_Introduction/simpleStreams# ldconfig -p | grep libcuda.so.1
	libcuda.so.1 (libc6,AArch64) => /usr/lib/aarch64-linux-gnu/nvidia/libcuda.so.1

(or with this change) The test application succeeds.

The host driver version returned on nvgpu (e.g. Thor) systems is
unreliable in terms of determining whether CUDA compat should be
used. Even though the "standard" compat libraries are used,
we should still only consider the host CUDA version and not the host
driver versions.

Signed-off-by: Evan Lezar <elezar@nvidia.com>
@elezar elezar added the tegra label Feb 25, 2026
@elezar elezar added this to the v1.19.0 milestone Feb 25, 2026
@elezar elezar added the blocker label Feb 25, 2026
@elezar elezar merged commit b48e32d into NVIDIA:main Feb 25, 2026
16 checks passed
@elezar elezar deleted the update-cuda-compat branch February 25, 2026 14:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant