Prev Next

Database / Milvus Vector database Interview questions

Explain the lifecycle of a search request in a distributed Milvus cluster?

A single search call from a client fans out across multiple components and, typically, multiple Query Nodes in parallel before being merged back into one final ranked result list.

sequenceDiagram participant Client participant Proxy participant QueryCoord participant QN1 as QueryNode A participant QN2 as QueryNode B Client->>Proxy: Search request (query vector, filter, limit) Proxy->>QueryCoord: Request collection/segment routing info QueryCoord-->>Proxy: Segment-to-QueryNode assignment Proxy->>QN1: Forward search for assigned segments Proxy->>QN2: Forward search for assigned segments QN1-->>Proxy: Partial top-K results QN2-->>Proxy: Partial top-K results Proxy->>Proxy: Merge and re-rank partial results Proxy-->>Client: Final top-K results

Because a collection's segments are typically spread across multiple Query Nodes, the Proxy fans the same search request out to every Query Node holding a relevant segment, each of which independently computes its own local top-K results against just its assigned data. The Proxy then merges those partial result sets, since the globally correct top-K answer requires comparing across all of them, not just trusting any single node's local ranking, and returns the final merged, correctly-ranked list back to the client.

This fan-out-and-merge pattern is what lets search latency stay low even as a collection's total data volume grows into the billions of vectors: the actual per-node search workload for any given query stays roughly proportional to that node's share of the data, not the collection's total size, as long as segments are reasonably balanced across the Query Node fleet.

Why does the Proxy merge partial results from multiple Query Nodes rather than trusting a single node's answer?
The fan-out-and-merge search pattern helps keep latency low as data grows because:

More Related questions...

What is Milvus? What is a vector database, and how does Milvus fit that category? What is a Collection in Milvus? What is a Partition in Milvus? What is a Segment in Milvus? What is an embedding vector, in the context of Milvus? What is an index in Milvus, and why is it needed? What are the main vector index types Milvus supports? What is HNSW, and why is it commonly used in Milvus? What are the similarity/distance metrics Milvus supports? What is the difference between L2 and Cosine similarity in Milvus? What is Milvus Lite? What is Zilliz Cloud? What are the main components of Milvus's architecture? What is the Proxy component in Milvus? What is a Query Node in Milvus? What is a Data Node in Milvus? What is loading a collection in Milvus, and why is it required before search? What is a scalar field in Milvus, and how is it used with vector search? What is dynamic schema in Milvus? What are Milvus's consistency levels? What is a Replica in Milvus? What is hybrid search in Milvus? What is a sparse vector in Milvus? What are the main use cases for Milvus? Explain the data flow of an insert operation in Milvus, from client to searchable segment? Why does Milvus separate compute and storage in its architecture? How does Milvus differ from a traditional relational database for storing vector data? What is the difference between IVF_FLAT and HNSW indexes in Milvus? How do you choose the right index type for a given Milvus workload? When should you use IVF_PQ instead of IVF_FLAT? How do you troubleshoot slow search performance in Milvus? What is the difference between growing segments and sealed segments in Milvus? How does Milvus handle search on data that hasn't been indexed yet? Explain the internal working of Milvus's segment sealing and index-building pipeline? What is the difference between Milvus and Pinecone? How do you implement multi-tenancy in Milvus? Why use Partitions instead of separate Collections for data isolation? What is the difference between Strong and Bounded Staleness consistency in Milvus? How does Milvus's Timestamp Oracle (TSO) ensure operation ordering? When would you choose GPU-accelerated indexes (like CAGRA) over CPU-based indexes? How do you configure replicas in Milvus for read scalability? What is the difference between the Coordinator services and Worker nodes in Milvus's architecture? Explain the lifecycle of a search request in a distributed Milvus cluster? How do you optimize Milvus for cost at billion-vector scale? What is the difference between Milvus's tiered storage and traditional single-tier storage? How does Milvus's hybrid search combine dense and sparse vector results? Why should you avoid over-partitioning a Milvus collection? What is the difference between Milvus 2.x's coordinator-based architecture and the direction of Milvus 3.0's lake-native design? How do you troubleshoot out-of-memory errors when loading a large Milvus collection?
Show more question and Answers...


Comments & Discussions