AI / LLM Basics Interview Questions
What is Instruction Tuning?
Instruction tuning is a specific type of fine-tuning where a model is trained on examples of instructions paired with the responses that correctly follow them.
- Teaches a base model, which is only good at predicting plausible next text, to instead behave like a helpful assistant that follows a user's actual request
- Uses datasets of paired prompts and ideal responses covering a wide range of task types
- Is usually one part of a broader alignment process, often combined with techniques like RLHF
This is the step that transforms a raw, next-token-predicting base model into something that reliably answers questions and follows directions the way people expect a chatbot to behave.
What kind of examples does instruction tuning train on?
What does instruction tuning transform a base model into?
More Related questions...
