Prev Next

Database / Weaviate Vector database Interview questions

How do you troubleshoot poor recall after enabling quantization in Weaviate?

A drop in search quality after enabling compression usually traces back to a mismatch between the chosen technique's assumptions and the actual data, or a configuration that hasn't been tuned for the specific recall/compression trade-off the application needs.

  1. Check whether rescoring is enabled and working as expected - rescoring against uncompressed vectors is what recovers most of the recall quantization would otherwise cost; confirm it's actually active and its candidate pool size (how many compressed-search results get rescored) is large enough.
  2. Check the training set size for PQ/SQ - a training sample that's too small or unrepresentative of the collection's actual data distribution produces a poorly calibrated quantizer, directly hurting recall.
  3. Reconsider the compression level chosen - 1-bit RQ or BQ trade more recall for smaller memory footprint than 8-bit RQ; if recall matters more than memory in a given case, switching to a less aggressive compression level is often the direct fix.
  4. Compare against uncompressed baseline recall - benchmark the same queries against an uncompressed index to establish how much recall loss quantization is actually causing, rather than assuming a perceived quality drop is necessarily quantization-related at all.
  5. Check whether the embedding model's vector characteristics suit the chosen technique - some embedding distributions compress more gracefully than others; a technique that works well for one embedding model may perform worse for a different one with different dimensional characteristics.

Since quantization can't be disabled once set on a collection, it's worth benchmarking recall impact on a representative sample or a staging collection before enabling a given compression technique on a production collection at scale, rather than discovering an unacceptable trade-off only after it's already been applied.

A key mechanism that recovers recall lost to compression is:
Because quantization can't be disabled once set on a collection, it's wise to:

More Related questions...

What is Weaviate? What is a Collection in Weaviate? What is a vectorizer module in Weaviate? What is hybrid search in Weaviate? What is the HNSW index in Weaviate? What is a Flat index in Weaviate? What is the Dynamic index in Weaviate? What is a cross-reference in Weaviate? What are named vectors in Weaviate? What is Weaviate Cloud? What is quantization/compression in Weaviate, and why is it used? What is Rotational Quantization (RQ) in Weaviate? What is generative search (RAG) in Weaviate? What is multi-tenancy in Weaviate? What is Object TTL in Weaviate? What is the Weaviate Query Agent? What is a UUID's role for objects in Weaviate? What are properties in a Weaviate collection? What is BM25 in the context of Weaviate? What is the alpha parameter in Weaviate hybrid search? What are the main deployment options for Weaviate? What is replication in Weaviate? What is sharding in Weaviate? What are the main use cases for Weaviate? What is the difference between bringing your own vectors and using a vectorizer module? Explain the data flow of an object being vectorized and indexed in Weaviate? Why does Weaviate combine BM25 and vector search instead of using vector search alone? How does Weaviate differ from Milvus? What is the difference between HNSW and the HFresh index in Weaviate? How do you choose between PQ, BQ, SQ, and RQ quantization? When should you use the Dynamic index instead of always using HNSW? How do you troubleshoot poor recall after enabling quantization in Weaviate? What is the difference between rescoring and raw compressed-vector search? How does Weaviate's multi-tenancy isolate tenant data on disk? Explain the internal working of Weaviate's rescoring mechanism for quantized vectors? What is the difference between Weaviate and Pinecone? How do you implement RAG using Weaviate's generative search module? Why use cross-references sparingly, according to Weaviate's own guidance? What is the difference between rankedFusion and relativeScoreFusion in hybrid search? How does the Weaviate Query Agent route natural-language questions across collections? When would you choose multi-vector (ColBERT-style) embeddings over single-vector embeddings? How do you configure replication factor for high availability in Weaviate? What is the difference between Weaviate's REST/GraphQL API and its gRPC API? Explain the lifecycle of a hybrid search query in Weaviate? How do you optimize Weaviate for memory efficiency at large scale? What is the difference between PQ and RQ quantization internally? How does Weaviate decide which shard(s) to query for a given request? Why should you avoid excessive cross-reference traversal in a single query? What is the difference between Weaviate Database (self-hosted) and Weaviate Cloud? How do you troubleshoot a Weaviate collection running out of memory at scale?
Show more question and Answers...


Comments & Discussions