There was also a part of Jefferson's original constitutional draft that essentially gave blacks equal rights. But, much like the "separation of church and state," it never made it into the final document signed by the Constitutional Convention.
And since neither are in the document, it makes the idea that Jefferson said that (?) or wanted to free blacks (despite owning slaves himself) rather moot.