AI / LLM Basics Interview Questions
What is the purpose of a Loss Function during LLM training?
A loss function gives training a single number representing how wrong the model's predictions currently are, which is what the training process actually tries to reduce.
- Computed after each batch of training examples, comparing the model's predictions against the correct answers
- Used to calculate gradients, which indicate how each of the model's billions of parameters should be adjusted
- Training repeats this cycle, predict, measure loss, adjust parameters, millions of times over the training data
Without a loss function, there would be no concrete signal telling the training process whether a given adjustment to the model actually made it better or worse.
Invest now in Acorns!!! 🚀
Join Acorns and get your $5 bonus!
Acorns is a micro-investing app that automatically invests your "spare change" from daily purchases into diversified, expert-built portfolios of ETFs. It is designed for beginners, allowing you to start investing with as little as $5. The service automates saving and investing. Disclosure: I may receive a referral bonus.
Invest now!!! Get Free equity stock (US, UK only)!
Use Robinhood app to invest in stocks. It is safe and secure. Use the Referral link to claim your free stock when you sign up!.
The Robinhood app makes it easy to trade stocks, crypto and more.
Webull! Receive free stock by signing up using the link: Webull signup.
More Related questions...
