Skip to content

installation issue  #627

@noviljohnson

Description

@noviljohnson

hi,

os = windows 11
torch version = 2.3.0
cuda = 12.1
i have nvidia rtx 6000 ada
i installed xformers using pip install xformers==0.0.26.post1

i tried installing unsloth using
pip install "unsloth[cu121-ampere-torch230] @ git+https://github.com/unslothai/unsloth.git"

i got the following error

  error: subprocess-exited-with-error

  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [20 lines of output]
      fatal: not a git repository (or any of the parent directories): .git
      C:\Users\Nx\AppData\Local\Temp\pip-install-u_fln99t\flash-attn_f68a0c1127ed4af8859a0162fab5cb67\setup.py:78: 
UserWarning: flash_attn was requested, but nvcc was not found.  Are you sure your environment has nvcc available?  If you're installing within a container from https://hub.docker.com/r/pytorch/pytorch, only images whose names contain 'devel' will provide nvcc.
        warnings.warn(
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "C:\Users\Novilsaikumar.A\AppData\Local\Temp\pip-install-u_fln99t\flash-attn_f68a0c1127ed4af8859a0162fab5cb67\setup.py", line 134, in <module>
          CUDAExtension(
        File "C:\Users\Novilsaikumar.A\.conda\envs\test\lib\site-packages\torch\utils\cpp_extension.py", line 1077, in CUDAExtension
          library_dirs += library_paths(cuda=True)
        File "C:\Users\Novilsaikumar.A\.conda\envs\test\lib\site-packages\torch\utils\cpp_extension.py", line 1211, in library_paths
          paths.append(_join_cuda_home(lib_dir))
        File "C:\Users\Novilsaikumar.A\.conda\envs\test\lib\site-packages\torch\utils\cpp_extension.py", line 2419, in _join_cuda_home
          raise OSError('CUDA_HOME environment variable is not set. '
      OSError: CUDA_HOME environment variable is not set. Please set it to your CUDA install root.


      torch.__version__  = 2.3.0+cpu


      [end of output]

i installed nvcc using conda install -c nvidia cuda-nvcc
i installed cudatoolkit using conda install cudatoolkit -c anaconda -y
nvcc --version command works :
output

nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2024 NVIDIA Corporation
Built on Thu_Mar_28_02:30:10_Pacific_Daylight_Time_2024
Cuda compilation tools, release 12.4, V12.4.131
Build cuda_12.4.r12.4/compiler.34097967_0

when i tried installing unsloth using
pip install "unsloth[cu121-torch230] @ git+https://github.com/unslothai/unsloth.git"

i got the following error
ERROR: xformers-0.0.26.post1-cp310-cp310-manylinux2014_x86_64.whl is not a supported wheel on this platform.

help me to resolve this.

thanx

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions