There is an important distinction I want to make. "Sex drive" and "desire for sex" are two different things. The first is subconscious and the latter is conscious.

Sex drive is when you see a girl and something starts moving in your pants and you approach the girl and start courting her. It is natural and automatic.

Desire for sex is when you start worrying that you do not have enough sex. You see other people having more sex than you do. You start craving for sex. You start contemplating on how to get more sex. You start browsing the Internet. You start to design intricate plans on how to get more sex. You start living your life focused on sex.

Having sex acts like a drug in that it modulates our brain via hormones. The line between pleasure and addiction is a thin one. To have a "desire for sex" is like being a junkie on heroin. It means that you have an addiction and you let it take over your rational thoughts. If an addiction takes over our consciousness, happiness is an impossible outcome.

In order to lead a happy life, you want to stay far away from cultivating a desire for sex. This is very important:

Sex is an indifferent. You should be prepared to go without it forever, or to have it constantly, and maintain the same good spirit regardless.

Or as Epicurus put it, "Pleasure is the greatest good, but the way to attain it is to gain knowledge of the limits of one's desires".