This argument comes up in a number of ways, but it pretty much always ends in the same place: men assuming women look a certain way for them, because they see women as objects/property, and rape culture.

Anyway, this cluster-fuck is actually very easy to diffuse if you hit it early on by prioritizing the clothing itself; ask if, whichever piece of clothing it is, would be provocative on a man (spoilers: always yes). This is an easy way to establish the fact that a miniskirt, for example, is provocative no matter who wears it, and from there you can go pretty much anywhere:

Then it would appear that any difference in unwanted attention is largely down to what one wears.

If mini skirts are provocative, and women wear them more often, they will draw more attention than men, which sort of makes your premise it's own conclusion.

Yeah, that's why I don't wear mini skirts!

If they have a counter argument, it will most often be that it's not the same kind of attention ("why can't I be sexy?"), that it's because a man is acting like a woman (with the implication that female=bad) ("isn't dismantling gender rolls your priority?"), or simply that they're women's clothing ("why are you/is she wearing pants?").

The initial argument doesn't sound like a big deal, but it can go all kind of stupid places if you don't nip it in the bud.