Nope, you can run the 671B on 100% CPU and storage. It is going to be longer to get tokens out of it, but it will work.
Heard there are some optimizations for CPU inference on storage, then it should be somewhat a tad "less slow".
Time to split that RAM among your CPU cores and mmap blocks of weights for inference from storage.
