BigData / Apache Hudi Interview Questions
Define the Hudi Metadata Table?
The Metadata Table (MDT) is a Hudi-managed, internal key-value table — backed by the HFile format — that stores metadata needed for table operations directly inside the table itself, instead of relying on repeatedly listing files from cloud storage.
It holds things like file listings, per-file column statistics (min/max values), and bloom filters, all as O(1)-lookup key-value entries. This matters enormously at scale: listing a huge number of files directly against S3 or GCS is slow and can even throttle, while reading the same information from the Metadata Table's key-value store is fast and predictable.
The Metadata Table is backed by which storage format?
The Metadata Table mainly avoids the need to:
More Related questions...
