Prev Next

Web / Apache Solr Interview questions

How do you optimize Solr for high-throughput near real-time indexing?

High-throughput NRT indexing means tuning the tension between "documents should appear searchable quickly" and "commits and merges are expensive," rather than chasing either extreme.

  1. Tune commit intervals separately. Set a short autoSoftCommit (e.g. 1-3 seconds) for visibility, and a longer autoCommit with openSearcher=false (e.g. 60 seconds) purely for tlog durability - conflating the two forces unnecessary full searcher reopens.
  2. Batch writes and use concurrent clients. Many small single-document requests waste time on HTTP/JSON overhead; batching into a few hundred documents per request, sent from multiple threads, uses available CPU cores far better.
  3. Increase ramBufferSizeMB so more data accumulates in memory before a segment flush, reducing small-segment churn that background merges then have to clean up.
  4. Separate indexing and query load using replica types - route heavy indexing to NRT/TLOG leaders while PULL replicas absorb read traffic, so query latency doesn't spike every time a large batch lands.
  5. Watch merge behavior under load - if merges can't keep up with incoming segments, query latency degrades; increasing merge threads or adjusting the tiered merge policy's segments-per-tier can relieve this.

The right balance is workload-specific: a system ingesting logs at extremely high volume might accept a slightly longer soft-commit interval to protect query latency, while a live inventory system might need sub-second visibility and tolerate more merge overhead in exchange.

Why should autoSoftCommit and autoCommit typically be configured with different intervals?
Which replica-type strategy helps keep query latency stable during heavy indexing?

More Related questions...

What is Apache Solr? What are the types of fields in Solr? What is a Solr core? What is a Solr collection? What is SolrCloud? What is the purpose of solrconfig.xml? What is the purpose of managed-schema in Solr? Define analyzer in Solr? Describe tokenizer in Solr? What is a filter in the Solr analysis chain? What is an inverted index in Solr? How do you connect to Solr using SolrJ? List the ways to import data into Solr? What is the DataImportHandler in Solr? What are the types of Solr request handlers? How do you apply faceting in a Solr query? What is highlighting in Solr search results? What is the purpose of a query parser in Solr? What is the difference between stored and indexed fields in Solr? What is the difference between the standard query parser and DisMax? What is the difference between DisMax and eDisMax query parsers? What is the difference between q and fq parameters in Solr? What is the difference between soft commit and hard commit? Why is SolrCloud preferred over standalone Solr for production? How does Solr replication work in standalone (master-slave) mode? How does ZooKeeper coordinate a SolrCloud cluster? Why is leader election necessary in SolrCloud shards? What is the difference between NRT, TLOG, and PULL replicas in SolrCloud? When would you choose sharding over replication in SolrCloud? How does Solr handle distributed search across shards? Explain the execution flow of a Solr search request? Explain the lifecycle of a document from indexing to searchability in Solr? Why doesn't Solr return newly indexed documents without a commit? How do you troubleshoot slow Solr queries? How can you optimize indexing throughput in Solr? Explain the internal working of Solr's caching layers? How do you optimize faceted search performance on large collections? What happens when a Solr shard leader goes down? Which is better for autocomplete, EdgeNGram or the Suggester component, and why? How does Solr handle deep pagination, and why is cursorMark recommended over start/rows? Explain the execution flow of an atomic update in Solr? Why should you use docValues for sorting and faceting fields? How do you troubleshoot OutOfMemory errors in a Solr node? What is the difference between Solr's standard scoring and function queries? How does SolrCloud handle a split-brain or network partition scenario? Explain the internal working of Lucene segment merging in Solr? When should you use a custom similarity or scoring function in Solr? How do you optimize Solr for high-throughput near real-time indexing? What is the difference between Apache Solr and Elasticsearch? How do you secure a SolrCloud cluster in production?
Show more question and Answers...


Comments & Discussions