If Lyft and Uber allowed direct pricing, this wouldn't happen. Drivers would set the price they're willing to work for. Instead, drivers--who, once more for emphasis, are supposed to use price fluctuations as incentive or disincentive for working, that's what "surge pricing" was in the first place--only have one message that they can send: "nope, not at that price".

Or they can be obligated to work cheap because rich people demand their labor.

Hrm. I think I now understand where the claim of "fraud" comes from.