Prev Next

Database / Qdrant Vector DB Interview questions

Explain the internal working of Qdrant's sharding and replication?

Sharding splits a collection's data horizontally across multiple nodes so no single machine needs to hold the entire dataset, while replication keeps multiple copies of each shard on different nodes for fault tolerance — the two mechanisms work together to give a distributed Qdrant cluster both scale and resilience.

flowchart TD A[Collection created with shard_number = 3, replication_factor = 2] --> B[Data split into 3 logical shards by point ID hashing] B --> C[Each shard replicated to 2 nodes = 6 shard replicas total] C --> D[Node 1: Shard A primary, Shard C replica] C --> E[Node 2: Shard B primary, Shard A replica] C --> F[Node 3: Shard C primary, Shard B replica] G[Query arrives at any node] --> H[Coordinator fans out to relevant shard replicas] H --> I[Results merged and returned]

When a collection is created with a given shard_number, its points are distributed across that many logical shards (commonly by hashing each point's ID), and each shard is then replicated according to the configured replication_factor, spreading both the data volume and the read/write load across the cluster's nodes rather than concentrating it on one.

A query arriving at any node in the cluster is routed by a coordinator to the relevant shard replicas, which execute the search independently and return their local results, which the coordinator then merges into one final ranked answer — a process that's transparent to the client, which interacts with the cluster as if it were a single logical collection regardless of how many physical shards and replicas actually underlie it.

What does sharding split across multiple nodes?
What does replication provide, distinct from sharding?

More Related questions...

What is Qdrant? What is the purpose of Qdrant? What are the key features of Qdrant? What is a collection in Qdrant? What is a point in Qdrant? What is a payload in Qdrant? What is the HNSW algorithm? What distance metrics does Qdrant support? How do you create a collection in Qdrant? How do you insert/upsert points into a collection? What is the difference between REST and gRPC APIs in Qdrant? What client libraries are available for Qdrant? What is payload filtering in Qdrant? Define scalar quantization in Qdrant? What is a segment in Qdrant? How do you perform a similarity search in Qdrant? What is the purpose of a payload index? List the supported field types for payload indexing? What is Qdrant Cloud? What is memmap storage in Qdrant? What is the difference between Qdrant and Pinecone? What is the difference between Qdrant and Weaviate? Why is Qdrant implemented in Rust? How does the HNSW graph work internally in Qdrant? What is the difference between scalar, binary, and product quantization? Explain the internal working of binary quantization and why it's fast? What is oversampling and rescoring in quantized search? How does Qdrant implement filtering during HNSW traversal? Explain the internal working of Qdrant's sharding and replication? What consensus protocol does Qdrant use for distributed clusters, and how does it work? What are named vectors, and when should you use them? What are sparse vectors in Qdrant? Explain hybrid search using the Query API and Prefetch? What is Reciprocal Rank Fusion (RRF) versus Distribution-Based Score Fusion (DBSF)? How do you implement multitenancy in Qdrant? Explain the lifecycle of a write operation in Qdrant (WAL, segments, optimizers)? What is the role of the Write-Ahead Log (WAL) in Qdrant? How do you take and restore snapshots in Qdrant? What is the difference between keeping vectors on-disk versus the HNSW index in RAM? Explain the execution flow of a filtered vector search query in Qdrant? When should you choose binary quantization versus scalar quantization? How do you optimize Qdrant for high-throughput production workloads? What is the ACORN-1 method, and why does it matter for filtered search? Explain the internal working of Qdrant's segment optimizer/merging? How do you implement multi-vector (late interaction / ColBERT-style) search in Qdrant? What is the role of the payload index in query planning? How does Qdrant handle consistency during a node failure? Explain the execution flow of a RAG pipeline built with Qdrant as the retrieval layer? What are the trade-offs of self-hosting Qdrant versus using Qdrant Cloud? What is Qdrant's Discovery/Recommendation API used for?
Show more question and Answers...


Comments & Discussions