I've had a huge problem with trying to recognize anime eyes, because I can't really tell the difference between a girl being polite and smiling, and genuinely being interested. Usually they talk back, smile and focus on me while we are talking.

Is it really as simple as dilated pupils? That would be great, because then I'd have something easy to look for :)