How do I overcome being a push over?

You can’t feel like a man when your easy to overcome, I want to be more respected and taken seriously but how can I do that naturally?

Like with male friends I would say I don’t command the same respect that other people do. What is the reason for this that I can change? I know a common answer would be to learn a martial art but do I really have to know violence to be respected by my friends?