They sold less because they're far more expensive and have to compete against much more well put together products. Meanwhile, their platforms are 10 years old and there are now other offerings in an overall niche field.
You're right about aero to an extent, but aero is only felt on long highway drives and it can be mitigated somewhat with a couple more cells. Some consumers will choose style for a cost premium. Others will choose something more expensive simply because they don't want to support Musk.