Prev Next

Web / Apache Solr Interview questions

When would you choose sharding over replication in SolrCloud?

Sharding and replication solve different problems, and confusing them leads to either wasted hardware or a cluster that can't handle its data volume.

  • Replication - copies the same full data set to more nodes. Use it when a single shard's index already fits comfortably on one node's disk and memory, but you need more read throughput or fault tolerance.
  • Sharding - splits the data set across nodes. Use it when the collection is too large to fit, or perform well, on a single node - either the index size exceeds available memory for caching, or a single node can't sustain the indexing rate.

In practice these are combined: a large collection is split into several shards for size, and each shard is then replicated for availability and read scaling. The decision to add more shards versus more replicas should be driven by measuring whether the bottleneck is data volume/indexing load (add shards) or query concurrency (add replicas).

You need more read throughput and a single shard already fits comfortably on one node. What should you add?
Your index no longer fits well in a single node's memory. What is the appropriate fix?

More Related questions...

What is Apache Solr? What are the types of fields in Solr? What is a Solr core? What is a Solr collection? What is SolrCloud? What is the purpose of solrconfig.xml? What is the purpose of managed-schema in Solr? Define analyzer in Solr? Describe tokenizer in Solr? What is a filter in the Solr analysis chain? What is an inverted index in Solr? How do you connect to Solr using SolrJ? List the ways to import data into Solr? What is the DataImportHandler in Solr? What are the types of Solr request handlers? How do you apply faceting in a Solr query? What is highlighting in Solr search results? What is the purpose of a query parser in Solr? What is the difference between stored and indexed fields in Solr? What is the difference between the standard query parser and DisMax? What is the difference between DisMax and eDisMax query parsers? What is the difference between q and fq parameters in Solr? What is the difference between soft commit and hard commit? Why is SolrCloud preferred over standalone Solr for production? How does Solr replication work in standalone (master-slave) mode? How does ZooKeeper coordinate a SolrCloud cluster? Why is leader election necessary in SolrCloud shards? What is the difference between NRT, TLOG, and PULL replicas in SolrCloud? When would you choose sharding over replication in SolrCloud? How does Solr handle distributed search across shards? Explain the execution flow of a Solr search request? Explain the lifecycle of a document from indexing to searchability in Solr? Why doesn't Solr return newly indexed documents without a commit? How do you troubleshoot slow Solr queries? How can you optimize indexing throughput in Solr? Explain the internal working of Solr's caching layers? How do you optimize faceted search performance on large collections? What happens when a Solr shard leader goes down? Which is better for autocomplete, EdgeNGram or the Suggester component, and why? How does Solr handle deep pagination, and why is cursorMark recommended over start/rows? Explain the execution flow of an atomic update in Solr? Why should you use docValues for sorting and faceting fields? How do you troubleshoot OutOfMemory errors in a Solr node? What is the difference between Solr's standard scoring and function queries? How does SolrCloud handle a split-brain or network partition scenario? Explain the internal working of Lucene segment merging in Solr? When should you use a custom similarity or scoring function in Solr? How do you optimize Solr for high-throughput near real-time indexing? What is the difference between Apache Solr and Elasticsearch? How do you secure a SolrCloud cluster in production?
Show more question and Answers...


Comments & Discussions