Prev Next

Database / Weaviate Vector database Interview questions

How does Weaviate decide which shard(s) to query for a given request?

For a collection split across multiple shards, an unfiltered vector or hybrid search generally needs to query every shard, since the globally best-matching objects could in principle live on any of them, and Weaviate fans the request out accordingly, merging the per-shard results into one final ranked list, similar in spirit to how other distributed vector databases handle cross-shard search.

Multi-tenant collections are a notable exception to this fan-out pattern: because each tenant's data is physically isolated in its own dedicated segment (effectively acting as its own shard boundary), a tenant-scoped query only ever needs to touch that specific tenant's segment, skipping every other tenant's data entirely rather than needing to fan out across the whole collection's shards. This is part of why multi-tenant queries in Weaviate can remain fast even as the total number of tenants (and total collection size) grows very large, since a given query's cost stays tied to one tenant's data volume rather than the collection's aggregate size.

For non-multi-tenant collections that still need to avoid unnecessary shard fan-out, applying property-based filters that a shard-routing strategy can use to skip clearly irrelevant shards (where supported) is the general technique for narrowing which shards actually need to be queried for a given request, though the degree to which this is possible depends on how the sharding key relates to the filtered property.

For an unfiltered search on a sharded collection, Weaviate generally:
Multi-tenant queries can remain fast at large scale because:

More Related questions...

What is Weaviate? What is a Collection in Weaviate? What is a vectorizer module in Weaviate? What is hybrid search in Weaviate? What is the HNSW index in Weaviate? What is a Flat index in Weaviate? What is the Dynamic index in Weaviate? What is a cross-reference in Weaviate? What are named vectors in Weaviate? What is Weaviate Cloud? What is quantization/compression in Weaviate, and why is it used? What is Rotational Quantization (RQ) in Weaviate? What is generative search (RAG) in Weaviate? What is multi-tenancy in Weaviate? What is Object TTL in Weaviate? What is the Weaviate Query Agent? What is a UUID's role for objects in Weaviate? What are properties in a Weaviate collection? What is BM25 in the context of Weaviate? What is the alpha parameter in Weaviate hybrid search? What are the main deployment options for Weaviate? What is replication in Weaviate? What is sharding in Weaviate? What are the main use cases for Weaviate? What is the difference between bringing your own vectors and using a vectorizer module? Explain the data flow of an object being vectorized and indexed in Weaviate? Why does Weaviate combine BM25 and vector search instead of using vector search alone? How does Weaviate differ from Milvus? What is the difference between HNSW and the HFresh index in Weaviate? How do you choose between PQ, BQ, SQ, and RQ quantization? When should you use the Dynamic index instead of always using HNSW? How do you troubleshoot poor recall after enabling quantization in Weaviate? What is the difference between rescoring and raw compressed-vector search? How does Weaviate's multi-tenancy isolate tenant data on disk? Explain the internal working of Weaviate's rescoring mechanism for quantized vectors? What is the difference between Weaviate and Pinecone? How do you implement RAG using Weaviate's generative search module? Why use cross-references sparingly, according to Weaviate's own guidance? What is the difference between rankedFusion and relativeScoreFusion in hybrid search? How does the Weaviate Query Agent route natural-language questions across collections? When would you choose multi-vector (ColBERT-style) embeddings over single-vector embeddings? How do you configure replication factor for high availability in Weaviate? What is the difference between Weaviate's REST/GraphQL API and its gRPC API? Explain the lifecycle of a hybrid search query in Weaviate? How do you optimize Weaviate for memory efficiency at large scale? What is the difference between PQ and RQ quantization internally? How does Weaviate decide which shard(s) to query for a given request? Why should you avoid excessive cross-reference traversal in a single query? What is the difference between Weaviate Database (self-hosted) and Weaviate Cloud? How do you troubleshoot a Weaviate collection running out of memory at scale?
Show more question and Answers...


Comments & Discussions