Have you really been getting more girls in bed? Because usually men who are having sex tend to be able to hold up longer than men who aren’t. At any rate...practice, practice, practice.
If you consider yourself “above average” in four of the major parameters of dating where exactly are you lacking confidence? And yes, lack of self-esteem is a huge turn off for both women and men