Early days of PHP were total madness. GET vars initialized variables in the global namespace. Uninitialized variables treated as zero/empty string. People were rolling their own query sanitizers in the best case. Misconfigured servers often horked out script sources. Why not pour some gas on it with variable variables?

This level of introspection can be useful in some cases. Perhaps the flaw is just in giving it such simple, attractive syntax.