AI / LLM Basics Interview Questions
What is a Foundation Model?
A foundation model is a large, broadly pretrained model designed to serve as a general-purpose base that can be adapted to many different downstream tasks.
- Trained on a wide, diverse dataset rather than for one narrow purpose
- Meant to be fine-tuned, prompted, or otherwise adapted for a wide range of specific applications
- Contrasts with a narrowly trained model built and tuned for just one specific task from the start
Most well-known LLMs are foundation models at their core, the same base model can end up powering a chatbot, a coding assistant, and a summarization tool, just adapted differently for each use case.
More Related questions...