AI / LlamaIndex Interview Questions
What is a response synthesizer?
A response synthesizer is the piece of a query engine that takes the Nodes returned by a retriever, combines them with the user's query, and prompts the LLM to produce the final answer text.
It's separate from the retriever on purpose: retrieval decides which text is relevant, while synthesis decides how that text gets turned into a coherent response, including how many LLM calls are made and in what order the Nodes are processed.
LlamaIndex ships several synthesis strategies, selected via the response_mode parameter, such as refine, compact, and tree_summarize, each trading off answer quality, latency, and cost differently.
A response synthesizer's job is to:
The synthesis strategy is controlled by which parameter?
More Related questions...
