Emily's Cat
Rarely prone to hissy-fits
My question is, is this sort of behavior only unacceptable when a man does it? Is this related to physical superiority somehow, or is it objectively a personal violation where harm was done?
Personally, I think the behavior is unacceptable no matter who does it. It's a personal violation if an objective bystander would view it as such. In my view, yes, it would be a personal violation - but it's up to you to determine whether or not that violation merits taking legal action.
Physical superiority comes into play when you consider the degree of agency involved. In the case of a typical male and female, with typical size and strength differences, both are equally capable of saying no and making their disagreement known. But they're not equally capable of fighting off a persistent person. If a typical female has malicious intent regarding the body of a typical male, there's a high likelihood that the male will be capable of physically stopping that female and preventing her from doing physical harm. On the other hand, if a typical male has malicious intent regarding the body of a typical female, there's a high likelihood that the female will NOT be capable of physically stopping that male and preventing him from doing physical harm. There's a power imbalance that needs to be considered.
Consider a significant age difference between a 16 year old student and a 32 year old teacher. Even if there's not a physical capability difference, there's still a power and authority aspect that needs to be considered. Even if the teacher is a female and the student is a male, the teacher still retains authority and power over the student. The effect of that power discrepancy is a limitation of the agency of the student - even if the student were able to physically dominate the teacher.
As an alternative analogy, consider two scenarios involving mugging. In the first scenario, the mugger approaches you with no weapons, and demands that you give them your wallet. In the second scenario, the mugger approaches you with a pistol pointed at your head and demands that you give them your wallet. In both cases, the demand from the mugger is the same, but the degree of agency you have in those two scenarios is different. In the first scenario, you have a meaningful choice between complying with the mugger's demand or deciding to fight them off. There's a non-negligible likelihood that you could fight the mugger off, or outrun them, or otherwise act in self-defense and retain your wallet. In the second scenario, however, the presence of a pistol pointed at your head effectively negates the possibility of successful acts of self-defense.
Even though the actions being taken by the transgressor are the same, the power dynamic between the two scenarios is not.