Yeah, that's the thing. If gas ever gets back up to $4/gallon in the US, EVs which are just somewhat competitive at $2/gallon are going to be radically competitive.
However, if EVs become widely used, then the lower demand for gasoline will mean gas prices stay low. So long-term, EVs need to compete with low gas prices anyway, even if prices creep back up in the near-term.
But yeah. Once batteries are cheap enough, then electric vehicles may actually become cheaper than internal combustion engine vehicles /upfront/, in addition to the much lower running costs.