undefined | Better HN

0 pointsjhanschoo1y ago0 comments

A basic transformer architecture performs only a bounded amount of computation per generated token, so it can never emulate a machine computing sufficiently hard problems.

0 comments

EVa5I7bHFq9mnYK1y ago

Yes, because it's feed forward. It must have loops to be a Turing machine.

phkahler1y ago

It does. The output is fed back in.

jhanschooOP1y ago

It indeed does, but it must generate a token per loop, and can thereby solve some linearly complex problems, but it cannot solve harder problems.

j / k navigate · click thread line to collapse