Sonny was Clemenza's godson, so he was personally avenging his killing by taking care of Carlo.

If that was his thinking, what did he have to lose?

And maybe he thought it was better to die quickly in a gun battle, not knowing that perhaps Michael had a more tortuous way planned for him to go.