I concur as well. I think the scene showed that Geary was in Michael's pocket. I also think that he excused himself because he was also worried about putting himself in an awkward position.

This scene moreover reveals Geary as the jellyfish he is. Remember when he told Michael that he didn't like his kind with the silk suits and greasy hair, and contrast it with his praise of Italian-Americans.