A sizeable number of people think that "trans woman" means a female who identifies as male. Another sizeable number of people think that "trans woman" solely means someone who has had surgery to remove some or all of their male genitalia - despite the fact that upwards of 80% of trans-identifying males never have any surgery or take cross-sex hormones. I am not suggesting that the women you speak to are labouring under either of those misapprehensions or any others, but it's important that any surveys, formal or informal, which are presented in this thread as support for the idea that women don't care if males are in single-sex spaces take into account that terminology may mean different things to different people.
In any case, the women to whom you speak cannot consent to males in female single-sex spaces on behalf of other women. They can only consent to it on their own behalf.
The issue of Muslim and Jewish women who are not permitted by their religion to be unclothed in spaces where men are, such as toilets and changing rooms, is still being ignored by the men's rights supporters in this thread, which is disappointing.