It's a workplace. You don't just do whatever you feel like doing. You closely manage your appearance, demeanor, and conversation to be as helpful and productive as possible. You don't tell rude jokes because they might not be in others' taste. You don't leave trash lying around because some of your coworkers might be bigger neat-freaks than you. You don't sing to yourself loudly at your desk, blast music from your workstation without headphones, or wear a shirt that says "Go Fuck Yourself" on it. These aren't rules that are being enforced on the general population. They're a code of conduct for a cohort of like-minded people who are voluntarily working under that contract of behavior to accomplish something. We're trying to get work done here. It's not about restricting you, it's about enhancing the productivity of the whole. A manager should try their best not to make somebody feel self-conscious about what they're wearing - it's distracting and unpleasant. But that employee shouldn't put their manager in a situation where they feel like they have to mention it. Any given person, garment and culture might be on one side of that line or the other. It's a two-way street. You sacrifice hundreds of freedoms every day you go to work. Dress code isn't magically excluded just because men are more prone to visual distraction than women.