The drones in Ukraine largely use miles-long spools of fiber optic cable, so while I agree that sourcing is a problem, bandwidth likely isn't. If you want to be creative there's probably a bunch of hybrid wireless/wired/semi-autonomous configurations that would allow for minimizing bandwidth requirements in practice, but it would still fall apart as soon as a reasonably powerful jammer is turned on.
Feels like a massed attack using fiber optics would have lots of problems with drones getting tangled in the cables of those in front of/above them or cutting the cable. The trouble with making them autonomous in a city is that means more sensors and compute on board which raises the cost. It's a hard problem.