Yep, it’s another Clint Eastwood movie.  From 1973, It’s High Plains Drifter.

I can remember the first time I saw this movie.  The scenes where he has his way with the town bitch and later seduces the hotelier’s wife struck me as some of the least realistic of the whole movie.  Watching it again, I find they could be the most accurate.