No, but they did snort a little coke together in season 3, just prior to Livia's funeral.

"Vaya con Dios, Castle. Go with God."
"God's going to sit this one out." The Punisher (2004)