BigData / Apache Hudi Interview Questions
What is compaction in Hudi?
Compaction is a background table service, specific to Merge-on-Read tables, that merges the row-based Avro log files accumulated for a file slice into its Parquet base file, producing a new, fully-merged columnar version.
Without compaction, a MoR table's log files would keep growing indefinitely, making both read-time merges and eventual full-table scans slower. Compaction can run synchronously (inline with ingestion) or, more commonly in production, asynchronously on a separate schedule so it doesn't block the write path.
Compaction is a table service specific to which table type?
Running compaction asynchronously mainly helps because it:
More Related questions...
