AI / LLM Basics Interview Questions
Describe Reinforcement Learning from Human Feedback (RLHF)?
RLHF is a technique used to further align a model's behavior with human preferences, using human judgments as the training signal instead of a fixed dataset of correct answers.
- Human reviewers compare multiple model responses to the same prompt and rank which ones they prefer
- Those rankings are used to train a separate reward model that predicts how much a person would like a given response
- The main model is then further trained using reinforcement learning to produce responses that score highly according to that reward model
RLHF is a major reason modern LLMs feel noticeably more helpful, honest, and safe to interact with compared to a purely pretrained or instruction-tuned model alone.
Invest now in Acorns!!! 🚀
Join Acorns and get your $5 bonus!
Acorns is a micro-investing app that automatically invests your "spare change" from daily purchases into diversified, expert-built portfolios of ETFs. It is designed for beginners, allowing you to start investing with as little as $5. The service automates saving and investing. Disclosure: I may receive a referral bonus.
Invest now!!! Get Free equity stock (US, UK only)!
Use Robinhood app to invest in stocks. It is safe and secure. Use the Referral link to claim your free stock when you sign up!.
The Robinhood app makes it easy to trade stocks, crypto and more.
Webull! Receive free stock by signing up using the link: Webull signup.
More Related questions...
