AI / LLM Basics Interview Questions
What is Hallucination in LLMs?
Hallucination is when a model generates text that sounds fluent and confident but is factually incorrect or entirely made up.
- Happens because a model is fundamentally predicting plausible next text, not verifying facts against a trusted source
- Can involve inventing citations, misremembering details, or confidently stating something that simply isn't true
- More likely on questions the model has little reliable training data about, or that require very precise, specific facts
Techniques like retrieval-augmented generation, grounding answers in retrieved documents rather than the model's memory alone, are commonly used to reduce, though not fully eliminate, hallucination.
What is a hallucination in an LLM's output?
What technique is commonly used to reduce hallucination?
More Related questions...
