"I was glad this house never went to strangers. First, Clemenza took it over, then you." It sounds like its inhabitants had right of first refusal.
Now, let's watch the films a little more closely. Who might you first think the "woman" would be? Maybe Frankie's daughter?
You know, some get so far afield with their speculations. Maybe the Munsters lived in the house also.