Advice on a possible set-up date

Hello all, I was hoping for some advice on a budding relationship. I was at a dinner party earlier hosted by my mother's boss. There were two women my age there, one was the boss's daughter and another was dating the boss's son. I mainly talked to the taken woman, because of seating arrangements and a pretty face. Not focusing on the other woman really. The wife called my mother hoping to set up a date between the daughter and I. I'm worried my chances are blown by showing to much interest in the taken woman. Opinions?