BigData / Apache Hudi Interview Questions
How does the Record-Level Index (RLI) improve on the Bloom index?
The Record-Level Index (RLI), added in Hudi 0.14.0, stores a direct record key → file group mapping inside the Metadata Table, backed by the HFile format, giving O(1) key lookups instead of the range-pruning-plus-probabilistic-check approach the Bloom index uses.
Because it's a global index by design, RLI also avoids the operational complexity of standing up an external system like HBase just to get fast, table-wide key lookups — something large-scale deployments (Uber's included) previously relied on external indexes for. At very high record counts, this direct lookup is measurably faster than scanning bloom filters across many files, which is why it's the recommended index for the largest tables.
More Related questions...