Whether it be with men or women I find keeping eye contact at all times a bid hard because I lose track of what the other person is saying by focusing on their eyes. I noticed whenever I talk to someone if I actually follow what they're saying im going to think of a response/idea or whatever but while I'm doing it my eyes go to the side.

TL;DR hard to stay focused while keeping eye contact all the time, what gives?