undefined | Better HN

0 pointsancientworldnow1y ago0 comments

This was trained to be run at FP8 with no quality loss.

0 comments

The model description on huggingface says - Model size - 12.2B params, Tensor type - BF16. Is the Tensor type different from the training param size?

j / k navigate · click thread line to collapse

The model description on huggingface says - Model size - 12.2B params, Tensor type - BF16. Is the Tensor type different from the training param size?

j / k navigate · click thread line to collapse