undefined | Better HN

0 pointsfzzzy1y ago0 comments

it's very common to run local models in 8 bit int.

0 comments

Yes, but it's not common for the original model to be 8 bit int. The community can downgrade any model to 8 bit int, but it's always linked to quality loss.

j / k navigate · click thread line to collapse

0 comments

qwertox1y ago

Yes, but it's not common for the original model to be 8 bit int. The community can downgrade any model to 8 bit int, but it's always linked to quality loss.

j / k navigate · click thread line to collapse