Skip to content

[Issue]: unsloth compatiblity issue with torch therock windows #2008

@lihaofd

Description

@lihaofd

Problem Description

780M iGPU on windows
python -m pip install --index-url https://rocm.nightlies.amd.com/v2/gfx110X-all/ "rocm[libraries,devel]"
python -m pip install --index-url https://rocm.nightlies.amd.com/v2/gfx110X-all/ --pre torch torchaudio torchvision

https://docs.unsloth.ai/get-started/install-and-update/amd
pip install --no-deps unsloth unsloth-zoo
pip install --no-deps git+https://github.com/unslothai/unsloth-zoo.git
pip install "unsloth[amd] @ git+https://github.com/unslothai/unsloth"

https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/GPT_OSS_MXFP4_(20B)-Inference.ipynb

from unsloth import FastLanguageModel
always shows
AttributeError: module 'torch.distributed' has no attribute 'is_initialized'

Operating System

windows 11

CPU

7840U

GPU

780M

ROCm Version

2.10.0a0+rocm7.10.0a20251031

ROCm Component

No response

Steps to Reproduce

No response

(Optional for Linux users) Output of /opt/rocm/bin/rocminfo --support

No response

Additional Information

No response

Metadata

Metadata

Assignees

Labels

status: triageIndicates an issue has been assigned for investigation.

Type

No type
No fields configured for issues without a type.

Projects

Status
TODO

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions