I think it was Lucky Luciano who got busted carrying a loaded handgun.
He never carried again for that reason.

Tony Mirra carried a knife everyday because the penalty was far less severe than for a gun.

Albert DeMeo claimed that FRankie the wop carried routinely and one day was sitting on the toilet having a shit when a moth or mosquito began swarming about.
He nailed it dead with one shot but got busted when someone heard the shot and called the cops.

I think as a basic rule of thumb, made guys would only carry when doing a hit.