The guys on the Sopranos not only carry guns, they carry relatively big guns, that are hard to conceal. When Tony got pinched for a gun, it was a big 9mm or a 45, plus he was packing while meeting another boss, a big no no. Most mafia murders have been historically done with smaller caliber guns like 22's and 380 semi autos.