Why does it matter if the average of all men and women is the same or not?

As long as equal pay for equal work is the law. People have free choice.