Yes, but not by much.
A coal power plant averages 33% efficiency. Gas is 42%. Source: google
> Neither of which have tailpipe emissions in populated areas unlike ICE.
CO2 doesn't care where it's emitted.
> But we do also use wind, solar, nuclear etc as power sources for BEV.
And nowhere near the power needed if everyone switched to EVs.