I generally do get initial glances but I struggle to maintain connections. One factor could be that I am very conscious of the fact that if my eyes are making the other person uncomfortable or not. It's a very involuntary act that my eyes drift of to bare skin or slight movements (eg, chest movemets, shirt moving, shoulders etc) and I immediately become conscious and as a result the fear emerges that I may come off as a creep. If a word exist maybe it would be a creep fobia?

It doesn't happen if I am deep into the conversation or in my playful extroverted mood.

I would appreciate any advice on how to deal with it.