I think math people may have a view of this question that is skewed in an interesting way.
Statistics is very useful and its common techniques are not difficult to apply.
But they seem to be very difficult to apply correctly. We have entire academic fields that are built mostly on the spurious application of statistical methods in contexts that make the whole project invalid.
And this sort of "techniques without theory" approach is what's being advocated for upthread and represents a failure mode that math people are unlikely to consider -- because they know that part of being able to apply a technique is being able to tell whether or not applying it is valid. Math people are unlikely to fall into the trap this approach sets. But the same people who want this approach are also likely to end up being hurt by it.