That's right, Buble's secret sauce to being fast is that is skips the code generation step, not because of the number of dependencies.
Although there definitely is a performance cost to Babel's large dep tree as each of these modules have to be found by Node (which is inefficient). If you use Babel with npm2 it is super slow, because npm2's folder structure causes more lookups.