undefined | Better HN

0 pointspetercooper1y ago0 comments

It's hardly cheap starting at about $10k of hardware, but another potential option appears to be using Exo to spread the model across a few MBPs or Mac Studios: https://x.com/exolabs_/status/1814913116704288870

0 comments

niutech1y ago

Or maybe using Distributed Llama? https://github.com/b4rtaz/distributed-llama

j / k navigate · click thread line to collapse

0 pointspetercooper1y ago0 comments

It's hardly cheap starting at about $10k of hardware, but another potential option appears to be using Exo to spread the model across a few MBPs or Mac Studios: https://x.com/exolabs_/status/1814913116704288870

0 comments

niutech1y ago

Or maybe using Distributed Llama? https://github.com/b4rtaz/distributed-llama

j / k navigate · click thread line to collapse