If it's a typical coffee and walk around the neighborhood first date what do you wear?

causal - jeans and a tee shirt Or a bit more formal - causal button-up and khakis?