I think it would've been better.. just the presence of another star could've slightly improved the film.
If you think about it, in the third film, there were no James Caan, Marlon Brando, Robert Duvall, Robert DeNiro and John Cazale.
Even Al Pacino wasn't at his best.. Robert Duvall could've probably played a decent supporting role there.. but that's just my opinion.