-
-
Notifications
You must be signed in to change notification settings - Fork 814
Closed
Description
When using bitsandbytes for huggingface (model = AutoModelForCausalLM.from_pretrained("bloom", device_map="auto", load_in_8bit=True)),
bitsandbytes tries to remove (as it seems) a system directory (!!)
File "/home/myUser/myproject/lib/python3.10/site-packages/bitsandbytes/cuda_setup/main.py", line 166, in remove_non_existent_dirs
if path.exists():
File "/usr/lib/python3.10/pathlib.py", line 1290, in exists
self.stat()
File "/usr/lib/python3.10/pathlib.py", line 1097, in stat
return self._accessor.stat(self, follow_symlinks=follow_symlinks)
PermissionError: [Errno 13] Permission denied: '/var/lib/lightdm-data/myUser'
python 3.10
bitsandbytes 0.37.0
arch linux
EDIT: chmod 777 /var/lib/lightdm-data/myUser (an empty dir) will not resolve the issue - bitsandbytes still crashes my program
Metadata
Metadata
Assignees
Labels
No labels