Is it possible that use candle library without CUDA? #2270
-
I've recently been using the candle library for text generation.
The model files I used were from here: Later, I added
I looked into Currently, I am stuck here. I'm hesitant to try installing the Display driver from CUDA because I'm worried it might conflict with my AMD GPU. |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
Solved, that's my mistake, I accidently turned on |
Beta Was this translation helpful? Give feedback.
Solved, that's my mistake, I accidently turned on
flash_attn
.When I turned it off, everything is fine.