The main difference here is modality of use -- taking something, once per day, in controlled doses, is very very different from taking something until you feel good. With a prescription, you also have a steady supply and no need to commit crimes to keep up your supply. So the societal problems from drug abuse, like overdose, increased criminality, and breakdown of relations don't happen with prescription drugs to the same extent, even if it's the same substance. Look at when the opoid crisis became a crisis -- it was when cheap, easy opioids stopped being available.