I think that concern exists in any altercation.While armed, I would think it is a bad idea to go “hands on”. If you are overpowered by them there is a probability of losing your firearm and potentially being used against you.
In my situation, my options were seriously limited. I had my own vehicle to my right, the fuel pump to my left, and the aggressor to my front in a narrow "corridor", essentially. There were people behind him that were not involved. I could have retreated behind my vehicle after climbing over the fuel hose but my family was in my car. Retreating would have left them vulnerable. I decided hands-on to be my only option at that moment.
Don't get me wrong though, I wouldn't have fought him long before drawing my weapon and firing a couple from the hip into his gut. Just not until I believed it was safe to do so.