There was nothing malicious or any misrepresentations with what he said. It was accurate.
Despite your apparent god-like knowledge to discern who we really are, I guarantee if you met me in person, you would not be able to tell I was once a guy. And this will be the case more and more as we come out earlier and can make decisions about our own biology.
Your approach isn't '"common-sense", it is blatantly exclusionary. Eddie Izzard is a woman and can use women's facilities and Elliot Page is a man and can use men's facilities. You can make excuses for your transphobia all you want, but you don't get the right to deny them, or me, our equal rights.
Hell, you can't even call me a woman, instead referring to me as 'they' and 'them' now to try to get around it and so you don't run afoul of the mods. Your bigotry will die out, and you will be left screaming into the void.