Exactly. The DJs that are innovative, crate digging, slightly pretentious music nerds are almost exclusively hobbyists, with a vanishingly tiny percentage of them being able to eek out a meagre living from it. The majority of full time DJs cater to mainstream audiences who absolutely
do want to hear the same 50 - 100 tracks on rotation every time they go out. They want to dance and sing along to music that they're familiar with, and if the DJ doesn't play what they know then they won't dance, they won't stay, and the DJ won't remain employed.
It's actually very similar to web design - innovation has its place, but 99% of the time people want familiarity.
Source: spent a decade as a professional DJ