undefined | Better HN

0 pointsvaline2y ago0 comments

Fine tuning is moderately intense. Going from base LLaMA to Vicuna 13B costs about $300.

0 comments

The compute requirements are reasonable, but the memory requirements are extremely high, even with some upcoming breakthroughs like 4 bit bitsandbytes.

j / k navigate · click thread line to collapse

0 pointsvaline2y ago0 comments

Fine tuning is moderately intense. Going from base LLaMA to Vicuna 13B costs about $300.

0 comments

brucethemoose22y ago

The compute requirements are reasonable, but the memory requirements are extremely high, even with some upcoming breakthroughs like 4 bit bitsandbytes.

j / k navigate · click thread line to collapse