AI / LLM Basics Interview Questions
What is Perplexity in language modeling?
Perplexity is a metric that measures how well a language model predicts a given piece of text, essentially quantifying how "surprised" the model is by the actual next words.
- Lower perplexity means the model assigned higher probability to what actually happened next, indicating a better fit to that text
- Commonly used to evaluate and compare language models during development, especially on held-out test data
- Doesn't directly measure whether a model's output is factually correct or genuinely useful, just how predictable the text was to the model
Perplexity is a useful, easy-to-compute proxy for language modeling quality, but it's just one signal among several used to judge whether a model is actually good at real tasks.
Invest now in Acorns!!! 🚀
Join Acorns and get your $5 bonus!
Acorns is a micro-investing app that automatically invests your "spare change" from daily purchases into diversified, expert-built portfolios of ETFs. It is designed for beginners, allowing you to start investing with as little as $5. The service automates saving and investing. Disclosure: I may receive a referral bonus.
Invest now!!! Get Free equity stock (US, UK only)!
Use Robinhood app to invest in stocks. It is safe and secure. Use the Referral link to claim your free stock when you sign up!.
The Robinhood app makes it easy to trade stocks, crypto and more.
Webull! Receive free stock by signing up using the link: Webull signup.
More Related questions...
