Why? We've done it for ages, most trust in Wikipedia, and before most trusted in encyclopedias. Books written by others have been used forever. We just shift where we place the trust over time.
I just googled ‘do I need a license to drive a power boat in UK’
I got AI answer saying ‘no’, but actually you do.
If I use a calculator it will be correct. If I open encyclopaedia it will mostly be correct, because someone with a brain did at least 5 minutes of thining.
We are not talking about some minor detail, AI makes colossal errors with great confidence and conviction.
But you're comparing apples to oranges anyway... a mathematical problem is vastly different than a q&a problem - which of course involves language which is anyway a lossy form of communication.