I have another possibility:

One of Kay's issues with having Anthony raised on the compound was the company he kept. "Anthony's friends are your buttonmen!"

Maybe one of Anthony's loose-lipped "friends" let something slip and Anthony figured things out (and told Kay).

"A man in my position cannot afford to be made to look ridiculous!"