Different people care about different things. If Tesla gets 0% of the "we care most about fit and finish" market, that's fine at Tesla's current market share.
Tesla's clearly an internals/advance core tech co vs. a design/polish co., because of Elon's personality (like most entrepreneurs), and so still attracts earlier adopters.
I had an S and traded it in for a Model 3. I ended up liking the Model 3 more since it's much more nimble and gets the latest software updates. The S was nice, but felt like I'm driving a boat.
S is a different body size entirely, and Model 3 has some more advanced tech (e.g. more power-efficient) until S refreshed. 3 is actually cannibalizing S sales.