undefined | Better HN

0 pointsxwowsersx2y ago0 comments

Right, but what do you think about the point ch4s3 made below, namely that AI is non-deterministic? Isn't that a core difference? The COBOL compiler produces the same output for the same input, i.e. the compiler acts as a pure function.

0 comments

krona2y ago

There's nothing requiring non-determinism in these models, it's just there as a means to increase variety. There are obviously scenarios where this makes less sense.

joaogui12y ago

Kinda, there are GPU kernels that are sped-up by being non-deterministic, so you also gain performance with non-determinism

tough2y ago

Doesn't 0 temp give you determnistic outputs tho?

Also you need to translate/expand once (or multiple times, add tests, pick best benchmarked solution)

Where this could be useful would be in handling updates of packages and API's by itself. if you integrate only by prompt/words the AI can generate the appropiate latest lib integration that happens to work with your system or whatever

mike_hearn2y ago

Even temp=0 isn't fully deterministic for some reason, most likely floating point non-associativity and related issues.

Aperocky2y ago

Is that supposed to be a good thing when you're generating code?

Accepting varied non-deterministic input, great. The same input generate different code each time, not the "feature" that you'd think it is.

j / k navigate · click thread line to collapse