AI / LLM Basics Interview Questions
What is an Embedding in the context of LLMs?
An embedding is a list of numbers, a vector, that represents a token's meaning in a way a neural network can do math with.
- Words with similar meanings end up with embeddings that are mathematically close to each other
- Generated by an embedding layer that's learned during training, not manually assigned
- Used as the very first step inside the model, converting each input token into its vector form before any further processing happens
Beyond just being an internal step inside an LLM, embeddings are also used directly for tasks like semantic search and clustering, where comparing the "closeness" of two pieces of text's meaning is the whole point.
Invest now in Acorns!!! 🚀
Join Acorns and get your $5 bonus!
Acorns is a micro-investing app that automatically invests your "spare change" from daily purchases into diversified, expert-built portfolios of ETFs. It is designed for beginners, allowing you to start investing with as little as $5. The service automates saving and investing. Disclosure: I may receive a referral bonus.
Invest now!!! Get Free equity stock (US, UK only)!
Use Robinhood app to invest in stocks. It is safe and secure. Use the Referral link to claim your free stock when you sign up!.
The Robinhood app makes it easy to trade stocks, crypto and more.
Webull! Receive free stock by signing up using the link: Webull signup.
More Related questions...
