Yeah that's my thought. I guess if everyone was open about it maybe at most ⅓ of men would be gay or bi. I (m) personally am disgusted by the thought of touching someone elses dick or thinking about being intimate with another man. I know that a friend of mine (m) feels the same.
You need to keep in mind that the distribution of attractiveness is a bell-curve. That means that 70% of people are between 4 and 7, 8+ are the top 1%, 3 and below are the bottom 5%.