Legally speaking for rights to spaces it seems people are always up in arms and the entire discussion of opposition is men being in women's bathrooms or locker rooms. That is the point that everyone thinks is the most important reason to be against this.

This completely discounts female predators, and one thing nobody seems to think about is how easy it would be to make a false allegation against a male if a female went into a mens bathrooms.