I don't live in NY, so I can only speculate. But the mob will never be completely eliminated. They may go through down periods, but they'll probably always be around.

In regard to your specific question, it's quite simple: most of the mob figureheads went to jail in the 1990s (Gotti, Gotti Jr., Gravanno, Vincent "The Chin" Gigante, to name a few).