BigData / Apache Hudi Interview Questions
What is HoodieStreamer (formerly DeltaStreamer)?
HoodieStreamer — called DeltaStreamer before Hudi 1.x renamed it — is Hudi's built-in ingestion tool for continuously or one-time moving data from an external source into a Hudi table.
It can pull from sources like Kafka, DFS files, or JDBC, apply an optional transformer and schema (including Confluent Schema Registry integration), and manage its own checkpointing so a restarted job resumes where it left off. It can also run in continuous mode, acting like a long-running streaming job that automatically schedules compaction and clustering alongside ingestion, which is why many teams use it instead of hand-rolling a custom Spark or Flink ingestion job.
HoodieStreamer was previously known as:
Running HoodieStreamer in continuous mode also handles:
More Related questions...
