undefined | Better HN

0 pointslostmsu4mo ago0 comments

You don't have to install the whole CUDA. They have a redistributable.

0 comments

Oh, I can't believe I missed that! That makes whisper.cpp and llama.cpp valid options if the user has Nvidia, thanks.

Whisper.cpp and llama.cpp also work with Vulkan.

Yeah, I researched this and I absolutely missed this whole part. To my defense I looked into this in 2023 which is ages ago :) Looks like local models are getting much more mature.

j / k navigate · click thread line to collapse

0 comments

tom_04mo ago

Oh, I can't believe I missed that! That makes whisper.cpp and llama.cpp valid options if the user has Nvidia, thanks.

lostmsuOP4mo ago

Whisper.cpp and llama.cpp also work with Vulkan.

tom_04mo ago

Yeah, I researched this and I absolutely missed this whole part. To my defense I looked into this in 2023 which is ages ago :) Looks like local models are getting much more mature.

j / k navigate · click thread line to collapse