-
Notifications
You must be signed in to change notification settings - Fork 2.9k
Add torch-tensorrt support to uv-torch crate #17050
Copy link
Copy link
Closed
Labels
enhancementNew feature or improvement to existing functionalityNew feature or improvement to existing functionality
Description
Summary
On my Ubuntu 20.04 with CUDA 12.8 (latest available on this OS version) this command
uv pip install --no-index --torch-backend cu128 -f https://download.pytorch.org/whl/torch-tensorrt torch-tensorrtinstalls packages built for CUDA 13.0 so importing torch_tensorrt fails. Specifying version further to torch-tensorrt==2.9.0+cu128 fixes the issue. As I understand, uv-torch crate already performs automatic flavor choosing for some torch packages but torch-tensorrt is not handled.
Example
No response
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or improvement to existing functionalityNew feature or improvement to existing functionality