undefined | Better HN

0 pointsjohn_alan22d ago0 comments

you can't run models that are bigger than 16GB, not comparable.

0 comments

sure you can. system ram is will be your limiter here.

it's too slow for usable inference though.

Slow and can’t run are different things, but I get your point.

j / k navigate · click thread line to collapse

0 pointsjohn_alan22d ago0 comments

you can't run models that are bigger than 16GB, not comparable.

sure you can. system ram is will be your limiter here.

it's too slow for usable inference though.

Slow and can’t run are different things, but I get your point.

j / k navigate · click thread line to collapse