Yes but if someone asks me for a source that Paris is the capital of France, I will go find a legitimate source for that information to include in my response, not hallucinate a source and steadfastly claim it is real.

AIs not remembering the source for the original fact is not the problem, the problem is that asking them to make sure their claims are supported by sources does not preclude them from making up the sources themselves.