undefined | Better HN

0 pointsdkjaudyeqooe1y ago0 comments

> A human brain doesn't need anywhere close to this volume of data, in order to be able to produce good output.

> I remember talking with friends 30 years ago

I'd say you're pretty old. How many years of training did it take for you to start producing good output?

The leason here is we're kind of meta-trained: our minds are primed to pick up new things quickly by abstracting them and relating them to things we already know. We work in concepts and mental models rather than text. LLMs are incredibly weak by comparison. They only understand token sequences.

0 comments

layer81y ago

That's the point I think. It should be possible to require orders of magnitude less data to create an intelligence, and we are far from achieving that (including achieving AGI in the first place even with those huge amounts of data).

dkjaudyeqooeOP1y ago

My point is it took a very large amount of data for a human to be able to "produce good output". Once it had its performance was of a different strata though.

j / k navigate · click thread line to collapse