It was indeed Moe's big mouth that made him a dead man. But he was probably killed as a precaution anyway as everyone knew that Moe's ego would not accept the humiliation of getting moved out by the Corleones. And he ofcourse already aligned himself with Barzini.
"It was between the brothers Kay -- I had nothing to do with it."
