Sure you can.
The inherent costs to provide services is similar, but Comcast can amortize costs over a larger customer base. If Comcast is at all competent (a huge if!) then they should have overall lower costs, even taking (probably reduced) profits into account.
Customer service needs to be provided, a mailing center to send out hardware, a billing system, technicians and installers need to be trained and dispatched, payroll for all said employees, and all the other costs of running a business that should, in theory, scale to Comcast's advantage.
And of course Comcast can offer quicker upgrades in service. By bringing resources to bear, they should be able to iterate on technology faster than a municipal provider can.
Comcast also has the advantages of bundling services, another way to recoup costs and compete vs the municipal provided service.
A well ran national company with should be able to put up one heck of a good free market fight going up against a municipality. The real question becomes, is Comcast able to put up that fight?
I don’t know what the specifics are in this case, but if they allow the municipal service to be funded by tax revenue, then it’s incredibly unfair.
This is more of a problem of how things look like they are funded.
Customers still pay the same price, but instead of $60 for Internet service, it may be $50 for Internet and $10 somewhere else. Or of course the city can tax the heck out of one subgroup of people and redistribute the funds.
I'd actually be OK-ish with a law saying that municipal broadband has to be self funded after initial rollout, I imagine that would maintain sufficient competition.
They don't have to be the best or even only free-market option: they have to avoid pissing off their customer base enough that people vote for a municipal option. Not sure they're doing very well at that...