Hallucination: confident guessing
A hallucination is when an AI states something false as if it were true. It happens because the model's job is to produce a likely next word, not a checked one. When it reaches a gap in its knowledge, it does not go blank. It fills the gap with whatever sounds right. That can be a book that was never written, a quote nobody said, or a date that is off by ten years. The unsettling part is the tone. A made-up answer arrives in the same confident voice as a correct one. Nothing in the wording tells you which is which.
Bias: it learned from us
Bias means the model's answers lean in an unfair direction. It does not come from the model having opinions. It comes from the data. Models learn from human writing and human-made labels, so they absorb human patterns, including the unfair ones. Suppose a company trains a hiring model on ten years of past hires, and most of those hires were men. The model learns "men get hired" as a pattern and starts marking down women. That is not a made-up example: a large company scrapped a hiring tool in 2018 for exactly this reason. Lopsided data in, lopsided decisions out.
Two quieter mistakes
- Stale knowledge: the model only knows up to its training cutoff. Ask about a new phone, a recent match result or this year's rules and it may confidently describe last year's.
- Misread question: a vague prompt forces the model to guess what you meant. Ask about "the bank" and it may pick the river, not the money.
- Neither of these looks like an error on the screen. Both read as smooth, finished answers.
How to check an answer
- Ask for sources, then actually open them. If the source does not exist or does not say that, the answer is a hallucination.
- Verify anything that matters with a second, trusted source: a textbook, a teacher, an official website.
- Ask the same question a different way. If the answer changes, it was a guess.
- Treat the reply as a first draft, not a final one. You are the editor.
The friend who always has an answer
Everyone knows someone who answers every trivia question instantly and never says "I'm not sure". They are great company and right surprisingly often. But you would not bet money on them without checking first. Treat an AI the same way. Enjoy the speed and the confidence. Just remember that the confidence is a writing style, not a guarantee of being right.
Predictable mistakes are catchable
None of this is a reason to avoid AI. It is a reason to use it with your eyes open. The mistakes follow patterns, and patterns can be checked for. Next: a tour of the AI already working around you, and what each one is quietly predicting.
Check yourself · 3 quick questions
An AI gives you a book title and author that turn out not to exist. What is this called?
Show answer
A hallucination — A hallucination is a confident, made-up answer produced when the model fills a gap with whatever sounds right.
Why can an AI be biased?
Show answer
Because it learned patterns, including unfair ones, from human data — Bias comes from the data: models absorb the patterns in human writing and human-made labels, fair and unfair alike.
An AI gives you a date for a school project. What is the best next step?
Show answer
Check it against a trusted source such as a textbook — Confidence is a writing style, not a guarantee; anything that matters should be verified with a second, trusted source.