Unfortunately (or fortunately, depends which way you look at it) men and women are held to different standards in a number of areas. One of those is physical standards and levels of body fat.
Whereas women can look pretty decent and fuckable at high body fat levels, men pretty much never do. High body fat on men is an absolute killer for their attractiveness. Being lean and decently muscular is crucial to looking attractive to women. There are men who chase chubby women. BBW porn exists for men and is very popular. There is no equivalent for women. Women find fat men disgusting and sexually unappealing in all senses.
You're probably higher body fat than you think. Do this test to see if you're too fat: Stand naked in front of a mirror. If you can't see any part of your abs without tensing, you're too fat.
I used to think I wasn't fat. I didn't have a beer belly like other men, I didn't have a double chin, I didn't have any obvious signs of fatness that you would associate someone with being fat. But I was still too fat to be attractive. My face was a bit puffy with baby fat on it. My pecs had a bit more fat than was ideal. I couldn't see any abs unless I tensed. I could feel the fat on the inside of my thighs. I wasn't obese, but I wasn't lean enough to be considered sexually attractive.
Now I try my hardest to keep my body fat to low levels. I realise that it's quite easy for me to put on fat or get a bloated look. This is especially true for any of you who are "bulking up" in the gym. There is no need to put on much fat. It makes you look unattractive. Even a man with a lot of muscle looks unattractive to women if he is above a certain level of body fat.
Women want to see your muscles - they find that sexy (look at all the statues from ancient times and the men were visibly lean with muscle definition and abs showing). They do not want your muscles hidden under a layer of fat. It's better to be 170lbs and reasonably lean, with abs and other muscles showing, than be 200lbs and have a fatter/bloated look.