undefined | Better HN

0 pointsjazzyjackson23d ago0 comments

Tokens per second is abysmal no matter how much ram you have

0 comments

Some models run worse than others but I have gotten reasonable performance on my M4 Pro with 24 GB of RAM

j / k navigate · click thread line to collapse

0 pointsjazzyjackson23d ago0 comments

Tokens per second is abysmal no matter how much ram you have

Some models run worse than others but I have gotten reasonable performance on my M4 Pro with 24 GB of RAM

j / k navigate · click thread line to collapse