undefined | Better HN

0 pointshazard4h ago0 comments

> Some engineers, given a fixed token budget, generate exponentially more (and better) output. Other engineers waste their tokens. The variance is enormous, and unlike most performance variance, it is now directly measurable. HR has never had a clearer signal of leverage.

This doesn't make sense to me. "A clearer signal of leverage" implies an objective way to measure software engineering output, which has been the white whale of engineering management for the last 50 years.

0 comments

api4h ago

It’s basically saying that good engineers are better at using the tool.

Because of course they are. This is true of every tool up to AI and it’s true for AI.

If you know what you’re doing you’re going to do a better job of getting the AI to produce good output. Isn’t that obvious?

dijksterhuis4h ago

> [performance variance between engineers] is now directly measurable [by measuring token usage]

… ie token use ~= productivity output

unfortunately measuring the number of tokens used is about as useful as a measure of productivity/performance as is measuring the number of times i hopped around on one foot last week (less time hopping ~= more time coding).

it’s just a measure of the number of tokens that an engineer used. it doesn’t necessarily mean that engineer is more productive. they might be doing more tokens because they ended up re-doing one minor feature a hundred times because they don’t understand the language / requirements etc. it could even be a negative relationship to productivity / performance!

pretty sure that’s what gp was getting at. see LoSC.

delusional3h ago

> It’s basically saying that good engineers are better at using the tool.

That's extremely reductive. It's perfectly possible for an engineer to be both a fantastic engineer, and bad at using AI. The opposite also exists, the great AI user, who is a terrible engineer.

The idea that these two "skills" are somehow 100% correlated or there's a causation link between them is completely unfounded. The person who becomes a fine engineer with AI, might have been an absolutely terrible engineer without it.

j / k navigate · click thread line to collapse