As much as I am a hot headed person, I agree with avoiding fights where you can.
Even if you pick them, he could be a smaller guy but all it takes is for someone to pull out a knife.
Or you could smash someone, they fall awkwardly, maybe hit their head on concrete. They pass away and then you end up in prison