Similarly, we think of our mind as being our "self" in a much more fundamental way than our toes.
If a person is female in their mind but has a male body, it seems very clear that we should consider the former to be their "real" gender. Why should the body matter more or be more fundamental?