How do I stop feeling like a pervert/rapist when expressing interest?

I was raised in a very conservative culture. One of the ways it has affected me is that I have a hard time seeing a middle ground: my options are to either not express my interest in women to them, or be a pervert/rapist. It's pretty irrational but I was never taught a healthy perception of my sexuality.