I think that people hate on chiropractors _because_ of the pseudo-science aspects. There also isn't much science -even empirical studies- that back up the claims of chiropractic (which doesn't have a noun form of the word for whatever reason).
A fortune-teller could probably give great advice about family relationships, but I'd recommend a counselor or therapist instead. And I'd probably treat the fortune-teller as a scam artist. In the same vein, a chiropractor might relax my back, but that doesn't make them credible.
Fun fact: the inventor of chiropractic was also big believer in the healing power of magnets, and was murdered by his son.