How high is the bar for casual sex ? Is it impossible for average men to get casual sex ?

When I say average, I don't mean ugly, I just mean unremarkable. The type of guy that doesn't stand out in the crowd.

I ask this because the 2 times I had casual sex (ONS) the guys were average, it was more about them being at the right place, at the right moment, than me being "viscerally" attracted to them.

Also I know guys who claim to have (had) casual sex and are average. So I wanted whether these guys are lying or something.

My questions is mainly directed toward guys who are really into the casual sex scene and know it well. Not towatd guys who struggle to get laid.