undefined | Better HN

0 pointsRC_ITR3y ago0 comments

>However, the complexity of our probabalistic word machine is far greater, in terms of both richness of inputs, motivation, and dimensionality.

If thought (as expressed in language) is just probabilistic pattern matching, then how did we develop our own training data from scratch?

0 comments

danans3y ago

There is a huge universe of inputs, aka training data, that feeds into us, far more than a digital text based LLM. From that we generated the training data for the LLM. That data is just a sliver of the human experience.

RC_ITROP3y ago

The universe contained exactly 0 words until humans created them, so if we are just stringing together words, then how did we make the words?

danans3y ago

> The universe contained exactly 0 words until humans created them,

Human words are one fork of the sound wave based communication systems that many animals on earth use. There was no distinct moment when we went from 0 to 1 words. There was no "first person to speak". We didn't make language. It emerged over time due to evolutionary pressures.

j / k navigate · click thread line to collapse

0 comments

danans3y ago

RC_ITROP3y ago

The universe contained exactly 0 words until humans created them, so if we are just stringing together words, then how did we make the words?

danans3y ago

> The universe contained exactly 0 words until humans created them,

j / k navigate · click thread line to collapse