I'm imagining an alternate version of the Wizard of Oz, where Dorothy clicks her ruby keyboard and says, "All benchmarks are flawed. All benchmarks are flawed. All benchmarks are flawed."
This is not an uncommon technique for comparing programming languages. We are not just trying to compare the performance of different implementations, but we are trying to compare the performance of different idiomatic programming styles in different languages. The shootout does the same thing. And yes, the shootout is also flawed.