The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable.
/usr/local/lib/python3.10/dist-packages/torch/cuda/init.py:716: UserWarning: Can't initialize NVML
warnings.warn("Can't initialize NVML")
Register as a new user and use Qiita more conveniently
- You get articles that match your needs
- You can efficiently read back useful information
- You can use dark theme