Skip to content

Blackwell compatibility (Windows only)#16817

Merged
catboxanon merged 2 commits into
devfrom
Blackwell
Jan 30, 2025
Merged

Blackwell compatibility (Windows only)#16817
catboxanon merged 2 commits into
devfrom
Blackwell

Conversation

@w-e-w

@w-e-w w-e-w commented Jan 30, 2025 •
edited
Loading

Copy link
Copy Markdown
Collaborator

Description

Switch to isntall early access pytorch wheels if the user is has a Blackwell GPU

wheels are upload to huggingface with permission from Nvidia
https://huggingface.co/w-e-w/torch-2.6.0-cu128.nv

from my testing all seems to work fine
apart from the optional --xformers

the current xformers pre-built only suppors pytorch 2.5.1

test was done with python 3.10 and 3.11 on 3090 and 1650 cards

if someone wish to test compatibility on non-blackwell cards
override the condiction at

stable-diffusion-webui/modules/launch_utils.py

Lines 333 to 339 in 0005760

if all([
os.environ.get('TORCH_INDEX_URL') is None,
sys.version_info.major == 3,
sys.version_info.minor in (10, 11, 12),
platform.system() == "Windows",
get_cuda_comp_cap() >= 10, # Blackwell
]):

note blackwell support should be considered experimental / theoretical
feedback with actual hardware test is more the welcome

Checklist:

@catboxanon

catboxanon commented Jan 30, 2025

Copy link
Copy Markdown
Collaborator

I have two GPUs installed, so the output returned by nvidia-smi can't be parsed.

>>> float(subprocess.check_output(['nvidia-smi', '--query-gpu=compute_cap', '--format=noheader,csv'], text=True))
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
ValueError: could not convert string to float: '8.6\n7.5\n'

@w-e-w

w-e-w commented Jan 30, 2025 •
edited
Loading

Copy link
Copy Markdown
Collaborator Author

thanks I see what's happening
I didn't know that could happen
it turns out I actually did know that this could happen I just forgot, I've encountered this exact issue in the past
https://github.com/w-e-w/stable-diffusion-webui-GPU-temperature-protection/blob/f388d7081945576ca2361c365d16f5edb3250412/temperature_sensor_modules/nvidia_smi.py#L8

@w-e-w

w-e-w commented Jan 30, 2025

Copy link
Copy Markdown
Collaborator Author

@catboxanon shoud be fixed

@catboxanon catboxanon merged commit 57e15ec into dev Jan 30, 2025
@catboxanon catboxanon deleted the Blackwell branch January 30, 2025 17:36
@w-e-w w-e-w mentioned this pull request Feb 3, 2025
Closed
w-e-w added a commit to w-e-w/stable-diffusion-webui that referenced this pull request May 2, 2025
@w-e-w
Blackwell compatibility (Windows only) (AUTOMATIC1111#16817)
93eab4b
@cjhScotland cjhScotland mentioned this pull request Aug 26, 2025
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@catboxanon catboxanon catboxanon approved these changes

@AUTOMATIC1111 AUTOMATIC1111 Awaiting requested review from AUTOMATIC1111 AUTOMATIC1111 is a code owner

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@w-e-w @catboxanon