when executing the line from kernels import *. Below is the error trace for reference:
===================================BUG REPORT===================================
Welcome to bitsandbytes. For bug reports, please submit your error trace to: https://github.com/TimDettmers/bitsandbytes/issues
================================================================================
...
AttributeError: /root/anaconda3/envs/group_chat/lib/python3.10/site-packages/bitsandbytes/libbitsandbytes_cuda117.so: undefined symbol: cdequantize_blockwise_fp16_nf4. Did you mean: 'cdequantize_blockwise_fp32'?
The main issue seems to stem from an undefined symbol cdequantize_blockwise_fp16_nf4 in libbitsandbytes_cuda117.so. The system suggests an alternative cdequantize_blockwise_fp32, but it's unclear if this is a suitable substitute.
when executing the line
from kernels import *. Below is the error trace for reference:The main issue seems to stem from an undefined symbol
cdequantize_blockwise_fp16_nf4inlibbitsandbytes_cuda117.so. The system suggests an alternativecdequantize_blockwise_fp32, but it's unclear if this is a suitable substitute.