It's happened to me two times already, when all I suggested was a coffee after chatting for a while. It typically started as a conversation, flirted a bit, talked about what we had in common, etc, and then I offered for coffee later this week and they'd pop that phrase on me.

Is it that I haven't built up enough rapport and made her comfortable? How do I respond to this in the future?