In countries with sufficient transportation alternatives, freedom of movement is still guaranteed even with your driver's license permanently revoked.
And I've never heard anyone use freedom of movement to argue against prisons, so I think we can all agree that limiting someone's movement can be an appropriate response to certain violations of law.