There's a gender imbalance in the publishing market, both for genres like science fiction and for what is considered "serious", "literary" fiction. This isn't just because there are fewer women writing literature (is this even true?). The reason is that women writing excellent literature are less likely to be acclaimed, or even published, than their male counterparts. So when people pledge to read 50% women writers, they aren't settling for less quality in favor of social justice -- they are simply seeking out great works that have been overshadowed for social reasons.
The confounding factor for TAM is the nature of the "credentials" being asked. Obviously, those credentials go beyond being an excellent professional and speaker. They also involve how prominent those speakers are in the skeptical community -- and one of the reasons for their prominence is that they are mostly white and male. Dawkins, for example, may be a great skeptic, but a black woman in his position might not have risen to fame like he did.
So the question here is whether TAM wants to make an effort to subvert these power structures, to rise up to the task of seeking out unknown but talented people, or if it wants to reflect society as it is. I don't think anyone is suggesting that the quality of the speakers be compromised. I can only speak for myself here, but what I'd like to see is an attempt to find equal or better talent that has been kept hidden for reasons other than their competence.