How do you deal with someone who butts in the middle of a conversation you're trying to strike up with someone?

How do you get someone like that to go away without seeming angry or combative?

Any other issues I should be aware of?