undefined | Better HN

0 pointsdexterlagan9mo ago0 comments

I have a similar setup but with 32 GB of RAM. Do you partly offload the model to RAM? Do you use LMStudio or other to achieve this? Thanks!

0 comments

Yes, LMStudio and it automatically does this.

j / k navigate · click thread line to collapse

Yes, LMStudio and it automatically does this.

j / k navigate · click thread line to collapse