San Jose is very much a suburbia-type city, very spread out, downtown is rather small and you need a car 90% of the time, whereas SF is much denser.
I assume the drug use/homeless issues are less prevalent in San Jose, at least it was that way 10 yrs ago.