I always thought the idea was that Al Neri killed the woman and had Geary think he did it. By this Tom told Geary he'd help him, then Geary would help the Corleone's.

His whole life was a million to one shot