As someone who's trying to renew his passport: Services have partially moved online (still have to attend in person...) but they still are bureaucratic nonsense, indeed.
Bureaucracy is Kafkaesque because of the complicated and seemingly random rules, because of the abundance of taxes, etc. There really needs to be a drastic reset of everything.
A good example: The attestation people had to print and fill in if they wanted to leave home during the lockdown. Why? This is bonkers even if it eventually became digital.
Another good example: Starting a business. I don't know if it can be simpler and faster than the way it works in the UK. In France, on the other hand...