Prev Next

Database / Weaviate Vector database Interview questions

How do you choose between PQ, BQ, SQ, and RQ quantization?

Each compression technique trades off training requirements, compression ratio, and recall retention slightly differently, and Weaviate's own guidance points toward a fairly clear default recommendation while leaving room for specific alternatives.

  1. RQ (recommended starting point) - no training needed, strong recall retention, available in 8-bit (moderate compression) and 1-bit (aggressive compression) variants; the sensible default for most new collections.
  2. BQ - also training-free and very fast, but generally less accurate than 1-bit RQ, which was specifically designed as a more robust successor to it.
  3. PQ - requires training on sample data (10,000-100,000 objects per shard recommended) but can be tuned for strong recall at a given compression level once trained; worth considering when RQ's compression/recall trade-off doesn't quite fit a specific dataset's characteristics.
  4. SQ - also requires training (100,000 objects per shard by default) and uses an over-fetch-then-rescore strategy internally to boost recall.

In practice, starting with RQ and only reaching for PQ or SQ if benchmarking against real data shows a specific, measurable recall or compression benefit for that particular dataset is a reasonable default strategy, since it avoids the added operational complexity of managing a training phase unless there's a concrete reason to.

Weaviate's documentation recommends which technique as a general starting point?
1-bit RQ was specifically designed as:

More Related questions...

What is Weaviate? What is a Collection in Weaviate? What is a vectorizer module in Weaviate? What is hybrid search in Weaviate? What is the HNSW index in Weaviate? What is a Flat index in Weaviate? What is the Dynamic index in Weaviate? What is a cross-reference in Weaviate? What are named vectors in Weaviate? What is Weaviate Cloud? What is quantization/compression in Weaviate, and why is it used? What is Rotational Quantization (RQ) in Weaviate? What is generative search (RAG) in Weaviate? What is multi-tenancy in Weaviate? What is Object TTL in Weaviate? What is the Weaviate Query Agent? What is a UUID's role for objects in Weaviate? What are properties in a Weaviate collection? What is BM25 in the context of Weaviate? What is the alpha parameter in Weaviate hybrid search? What are the main deployment options for Weaviate? What is replication in Weaviate? What is sharding in Weaviate? What are the main use cases for Weaviate? What is the difference between bringing your own vectors and using a vectorizer module? Explain the data flow of an object being vectorized and indexed in Weaviate? Why does Weaviate combine BM25 and vector search instead of using vector search alone? How does Weaviate differ from Milvus? What is the difference between HNSW and the HFresh index in Weaviate? How do you choose between PQ, BQ, SQ, and RQ quantization? When should you use the Dynamic index instead of always using HNSW? How do you troubleshoot poor recall after enabling quantization in Weaviate? What is the difference between rescoring and raw compressed-vector search? How does Weaviate's multi-tenancy isolate tenant data on disk? Explain the internal working of Weaviate's rescoring mechanism for quantized vectors? What is the difference between Weaviate and Pinecone? How do you implement RAG using Weaviate's generative search module? Why use cross-references sparingly, according to Weaviate's own guidance? What is the difference between rankedFusion and relativeScoreFusion in hybrid search? How does the Weaviate Query Agent route natural-language questions across collections? When would you choose multi-vector (ColBERT-style) embeddings over single-vector embeddings? How do you configure replication factor for high availability in Weaviate? What is the difference between Weaviate's REST/GraphQL API and its gRPC API? Explain the lifecycle of a hybrid search query in Weaviate? How do you optimize Weaviate for memory efficiency at large scale? What is the difference between PQ and RQ quantization internally? How does Weaviate decide which shard(s) to query for a given request? Why should you avoid excessive cross-reference traversal in a single query? What is the difference between Weaviate Database (self-hosted) and Weaviate Cloud? How do you troubleshoot a Weaviate collection running out of memory at scale?
Show more question and Answers...


Comments & Discussions