It's the power dynamic. If a little skinny dude gets beat up by a bro, noones impressed, maybe even a little dissapointed in bro for taking advantage of the situation. If skinny dude beats up bro, everyone laughs and gives little dude his dues. If two bros go toe to toe, then so what, best man wins.