I think "I betrayed my wife" was when he shut the door on Kay and not let her to be with her kids. It is a sad scene when Kay is crying and Michael shuts the door but I wouldn't blame him. Michael was a loyal man to his family kind of the way Vito was. Vito was blaming Sonny of having a mistress but Michael was NOT that kind of a man.