undefined | Better HN

0 pointsjvanderbot5mo ago0 comments

Ok, call me crazy, but I don't actually think there's any technical reason that a theoretical code generation robot needs emotions that are as fickle and difficult to manage as humans.

It's just that we designed this iteration of technology foundationally on people's fickle and emotional reddit posts among other things.

It's a designed-in limitation, and kind of a happy accident it's capable of writing code at all. And clearly carries forward a lot of baggage...

0 comments

ambicapter5mo ago

If you can find enough training data that does human-like things without have human-like qualities, we are all ears.

jvanderbotOP5mo ago

It can be simultaneously the best we have, and well short of the best we want. It can be a remarkable achievement and fall short of the perceived goals.

That's fine.

Perhaps we can RL away some of this or perhaps there's something else we need. Idk, but this is the problem when engineers are the customer, designer, and target audience.

sunir5mo ago

Quality Spock pun.

sunir5mo ago

Maybe. I use QWAN frequently when working with the coding agents. That requires an llm equivalent of interoception to recognize when the model understanding is scrambled or “aligned with itself” which is what qwan is.

j / k navigate · click thread line to collapse

0 pointsjvanderbot5mo ago0 comments

Ok, call me crazy, but I don't actually think there's any technical reason that a theoretical code generation robot needs emotions that are as fickle and difficult to manage as humans.

It's just that we designed this iteration of technology foundationally on people's fickle and emotional reddit posts among other things.

It's a designed-in limitation, and kind of a happy accident it's capable of writing code at all. And clearly carries forward a lot of baggage...

0 comments

ambicapter5mo ago

If you can find enough training data that does human-like things without have human-like qualities, we are all ears.

jvanderbotOP5mo ago

It can be simultaneously the best we have, and well short of the best we want. It can be a remarkable achievement and fall short of the perceived goals.

That's fine.

Perhaps we can RL away some of this or perhaps there's something else we need. Idk, but this is the problem when engineers are the customer, designer, and target audience.

sunir5mo ago

Quality Spock pun.

sunir5mo ago

j / k navigate · click thread line to collapse