What would be correctly done when someone is hitting on your girl? And how do you evaluate her response to the situation?

I always herd the "Don't do anything unless she is being annoyed" but what if she is not, should I just sit there and watch?