I also would pick the Mike to Fredo monologue, but for 2nd place Id have to go with Tom's line, "Can't do it Sally."

The way Robert Duvall delivers that line with that faint smile and then shakes his head a little bit, it seems almost apologetic but it comes off as very cold when taken in context.