I guess you could say freedom of religion is a human right but it's not a human right to be culturally integrated. And so you could absolutely be required to give up that freedom in order to integrate, in the same way your workplace may require you to be at your office and do certain things, which is clearly not a violation of your freedom.