Yes he was. It was a great scene showing how subtle Don Vito could be. He had been upset with Johhny for divorcing his first wife, so the comment wasn't entirely out of place, but it was made for Sonny's benefit.
I love the way Sonny looks at Tom immediately after Don Vito says that.