We're saying the same thing, so "misunderstanding" is a bit of a strong claim.
> At a crosswalk, drivers will slow down if they see a pedestrian heading towards the crossing; they don't need to (and won't) at other places.
They literally must. It's in the law I cited:
https://law.justia.com/codes/new-york/vat/title-7/article-26...
You can go to jail if you don't take due care to avoid hitting a pedestrian, or even an animal. The right of way of the person being hit is irrelevant. But sure, if you, pedestrian, cause an accident due to your failure to respect right of way, you have also violated a traffic law, and you could be punished for it.
In practice, in a place like NYC, you're going to have to go to pretty extreme lengths for this to apply. Maybe if you dart into traffic maliciously, and a car swerves to avoid you and hits something? I dunno. It's hard to imagine a scenario.