Prev Next

Web / Apache Solr Interview questions

When should you use a custom similarity or scoring function in Solr?

Solr's default BM25Similarity works well for general text relevance, so custom scoring should be reserved for cases where the default assumptions genuinely don't fit the domain, rather than applied as a default optimization step.

  1. Domain-specific term importance - if certain terms should never be down-weighted by document length normalization (e.g. short SKU codes vs. long descriptions), a per-field Similarity override lets you tune or disable length norms independently per field.
  2. Non-text ranking signals dominate - if business priority (sponsored placement, inventory level, margin) matters more than subtle text relevance differences, function queries and boost queries (bf, bq) at query time are usually sufficient and far easier to maintain than a custom Similarity class.
  3. A fundamentally different scoring model is needed - for example, implementing a custom Similarity to replicate a specific academic ranking formula, or integrating an external relevance model's score via a plugin.

In practice, most relevance problems that look like "we need custom scoring" are actually solved by combining eDisMax field boosts (qf=title^3 description^1) with a handful of function query boosts, without writing a single line of custom Java Similarity code. Full custom Similarity implementations are relatively rare in production because they add real maintenance and testing burden, and are best reserved for cases where query-time boosting genuinely can't express the needed ranking behavior.

What is often a simpler alternative to a full custom Similarity class for business-priority ranking?
Why are full custom Similarity implementations relatively rare in production?

More Related questions...

What is Apache Solr? What are the types of fields in Solr? What is a Solr core? What is a Solr collection? What is SolrCloud? What is the purpose of solrconfig.xml? What is the purpose of managed-schema in Solr? Define analyzer in Solr? Describe tokenizer in Solr? What is a filter in the Solr analysis chain? What is an inverted index in Solr? How do you connect to Solr using SolrJ? List the ways to import data into Solr? What is the DataImportHandler in Solr? What are the types of Solr request handlers? How do you apply faceting in a Solr query? What is highlighting in Solr search results? What is the purpose of a query parser in Solr? What is the difference between stored and indexed fields in Solr? What is the difference between the standard query parser and DisMax? What is the difference between DisMax and eDisMax query parsers? What is the difference between q and fq parameters in Solr? What is the difference between soft commit and hard commit? Why is SolrCloud preferred over standalone Solr for production? How does Solr replication work in standalone (master-slave) mode? How does ZooKeeper coordinate a SolrCloud cluster? Why is leader election necessary in SolrCloud shards? What is the difference between NRT, TLOG, and PULL replicas in SolrCloud? When would you choose sharding over replication in SolrCloud? How does Solr handle distributed search across shards? Explain the execution flow of a Solr search request? Explain the lifecycle of a document from indexing to searchability in Solr? Why doesn't Solr return newly indexed documents without a commit? How do you troubleshoot slow Solr queries? How can you optimize indexing throughput in Solr? Explain the internal working of Solr's caching layers? How do you optimize faceted search performance on large collections? What happens when a Solr shard leader goes down? Which is better for autocomplete, EdgeNGram or the Suggester component, and why? How does Solr handle deep pagination, and why is cursorMark recommended over start/rows? Explain the execution flow of an atomic update in Solr? Why should you use docValues for sorting and faceting fields? How do you troubleshoot OutOfMemory errors in a Solr node? What is the difference between Solr's standard scoring and function queries? How does SolrCloud handle a split-brain or network partition scenario? Explain the internal working of Lucene segment merging in Solr? When should you use a custom similarity or scoring function in Solr? How do you optimize Solr for high-throughput near real-time indexing? What is the difference between Apache Solr and Elasticsearch? How do you secure a SolrCloud cluster in production?
Show more question and Answers...


Comments & Discussions