Well, how far goes loyalty in general? I mean, if there has ever been a loyal person in history or fiction, it was Tom Hagen. But there's always a limit. And I think his loyalty was tested more often than that of Jesus. wink
Many times Michael has betrayed the memory of his father. So if Tom happened to distance himself from Michael it could be one way of keeping his loyalty to Vito.