Yes, men on average care about looks the most. But women also reinforce this by selecting for men who selected them for their looks.

Think about movies like Deadpool. He knows that as a burn victim, he's not much to look at. But he gets past it. He doesn't need his woman to be enchanted by his looks.

Meanwhile most women want the man they marry to think they look amazing and to tell them they're beautiful every day. Most women can't handle a man who loves them for their personal achievements, sense of humor and personality while thinking they look average. They can't handle it!