I’ve heard this comparison between C compilers and LLMs and I don’t think it’s similar.
there’s a direct relationship to C code and the resulting assembly.
The C language was specifically designed so that language constructs were converted into the intended assembly anyway.
C didn’t obfuscate the problem of writing code, just allowed us to operate at a higher, but still sound, level.
LLMs are not an abstraction like C. You aren’t going through a sound, tractable process going from natural language to code.
You’re going through a black box.
It’s no longer a new abstraction on top of a fundamental idea.
There is no understanding of anything being developed. Prompts aren’t even deterministic wrt the output of the LLM, so even how to prompt a given model isn’t something that can be understood or totally predicted. It’s just like SEO hacks.