I've attempted this, but if the car which triggered the light change clears the intersection in a particular time (say, with a right turn), the countdown completes only to go back to a "walk" signal.
Makes for some confusing signaling; but it's better than a red light for an empty crosswalk and cross street..