bitsandbytes项目CUDA环境配置问题分析与解决方案

我的cuda版本为12.6，该安装什么版本的bitsandbytes

import unsloth False ===================================BUG REPORT=================================== /root/ai/project/train/venv/lib/python3.10/site-packages/bitsandbytes/cuda_setup/main.py:167: UserWarning: Welcome to bitsandbytes. For bug reports, please run python -m bitsandbytes warn(msg) ================================================================================ /root/ai/project/train/venv/lib/python3.10/site-packages/bitsandbytes/cuda_setup/main.py:167: UserWarning: /usr/local/cuda/lib64: did not contain ['libcudart.so', 'libcudart.so.11.0', 'libcudart.so.12.0'] as expected! Searching further paths... warn(msg) The following directories listed in your path were found to be non-existent: {PosixPath('() { ( alias;\n eval ${which_declare} ) | /usr/bin/which --tty-only --read-alias --read-functions --show-tilde --show-dot "$@"\n}')} CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching in backup paths... DEBUG: Possible options found for libc

cuda12.2,bitsandbytes0.41.0,对应什么版本的torch

python -m bitsandbytes False ===================================BUG REPORT=================================== /home/anaconda3/envs/unsloth/lib/python3.10/site-packages/bitsandbytes/cuda_setup/main.py:167: UserWarning: Welcome to bitsandbytes. For bug reports, please run python -m bitsandbytes warn(msg) ================================================================================ /home/anaconda3/envs/unsloth/lib/python3.10/site-packages/bitsandbytes/cuda_setup/main.py:167: UserWarning: /home/anaconda3/envs/unsloth did not contain ['libcudart.so', 'libcudart.so.11.0', 'libcudart.so.12.0'] as expected! Searching further paths... warn(msg) /home/anaconda3/envs/unsloth/lib/python3.10/site-packages/bitsandbytes/cuda_setup/main.py:167: UserWarning: :/usr/local/cuda-12.4/lib64 did not contain ['libcudart.so', 'libcudart.so.11.0', 'libcudart.so.12.0'] as expected! Searching further paths... warn(msg) CUDA_SETUP: WARNING! libcudart.so not found in any environmental path. Searching in backup paths... DEBUG: Possible options found for libcudart.so: {PosixPath('/usr/local/cuda/lib64/libcudart.so')} CUDA SETUP: PyTorch settings found: CUDA_VERSION=124, Highest Compute Capability: 8.9. CUDA SETUP: To manually override the PyTorch CUDA version please see:https://github.com/TimDettmers/bitsandbytes/blob/main/how_to_use_nonpytorch_cuda.md CUDA SETUP: Required library version not found: libbitsandbytes_cuda124.so. Maybe you need to compile it from source? CUDA SETUP: Defaulting to libbitsandbytes_cpu.so... ================================================ERROR===================================== CUDA SETUP: CUDA detection failed! Possible reasons: 1. You need to manually override the PyTorch CUDA version. Please see: "https://github.com/TimDettmers/bitsandbytes/blob/main/how_to_use_nonpytorch_cuda.md 2. CUDA driver not installed 3. CUDA not installed 4. You have multiple conflicting CUDA libraries 5. Required library not pre-compiled for this bitsandbytes release! CUDA S