> No, if I ask a human about something he doesn't know, the first thing he will think about is not a made up answer, it is "I don't know".
You've just made this up, through. It's not what happens. How would somebody even know that they didn't know without trying to come up with an answer?
But maybe more convincingly, people who have brain injuries that cause them to neglect a side (i.e. not see the left or right side of things) often don't realize (without a lot of convincing) the extent to which this is happening. If you ask them to explain their unexplainable behaviors, they'll spontaneously concoct the most convincing explanation that they can.
You've just made this up, through. It's not what happens. How would somebody even know that they didn't know without trying to come up with an answer?
But maybe more convincingly, people who have brain injuries that cause them to neglect a side (i.e. not see the left or right side of things) often don't realize (without a lot of convincing) the extent to which this is happening. If you ask them to explain their unexplainable behaviors, they'll spontaneously concoct the most convincing explanation that they can.
https://en.wikipedia.org/wiki/Hemispatial_neglect
https://en.wikipedia.org/wiki/Anosognosia
People try to make things make sense. LLMs try to minimize a loss function.