Prev Next

AI / Apache Paimon Interview questions

How do you apply schema evolution during CDC ingestion into Paimon?

Paimon's CDC ingestion tooling can keep a target table's schema in sync with a changing source automatically, but only through the right ingestion path. Plain Flink SQL CDC ingestion does not propagate source schema changes to Paimon.

Using the dedicated sync actions instead — such as MySqlSyncTableAction for MySQL, or the equivalent Kafka/MongoDB/Postgres/Pulsar sync jobs — does propagate schema changes, including newly added columns and their data, without requiring the sync job to be restarted.

Supported changes are limited: Paimon can add columns and widen column types (e.g., a shorter string to a longer one, or a smaller integer to a wider one), but it cannot rename a table or drop a column through CDC sync — a RENAME COLUMN is instead applied as adding a new column.

To have source schema changes automatically propagate into a Paimon table, you should use:
Which schema change is NOT supported by Paimon's CDC ingestion?

More Related questions...

What is Apache Paimon? What is the purpose of Paimon's Catalog abstraction? What are the four types of metastores Paimon catalogs support? Define a primary key table in Paimon? What are the two main table types in Paimon? Describe a Paimon Snapshot? What are Manifest files used for in Paimon? What is a Bucket in Paimon? List the merge engines Paimon supports for primary key tables? What is the default merge engine in Paimon? What is the purpose of the changelog-producer table property? How do you use the sequence.field option in Paimon? What is Paimon's LSM tree used for? What are Sorted Runs in a Paimon LSM tree? Describe what Paimon's system tables are for? How do you use the $snapshots system table? What is the purpose of Tags in Paimon? What is an Append Table in Paimon? How do you apply schema evolution during CDC ingestion into Paimon? What are the consistency guarantees Paimon provides for writers? What is the purpose of the Audit Log system table? Describe the Read-optimized (ro) system table? Why does Paimon combine a lake format with an LSM-tree structure? How does the Deduplicate merge engine handle a DELETE record? What is the difference between the Partial Update and Aggregation merge engines? What is the difference between Fixed Bucket and Dynamic Bucket modes? When should you choose Postpone Bucket mode? What happens when Paimon's sorted runs contain overlapping primary key ranges? Why should changelog-producer be enabled only when necessary? What is the difference between the input and lookup changelog producers? How does the full-compaction changelog producer differ from lookup? Why do concurrent writers to the same partition only get snapshot isolation instead of full isolation? When should you choose the Hive catalog over the filesystem catalog? How can you optimize primary key lookups using the bucket-key option? What is the difference between the sequence.field and rowkind.field options? Explain the execution flow of a two-phase commit when a Paimon writer flushes data? Why is Cross Partitions Upsert more expensive than a normal bucketed upsert? How do you troubleshoot excessive small files from streaming writes into a Paimon table? What is the difference between the audit_log and binlog system tables? Explain the internal working of automatic tag creation with a watermark? When should you choose the REST catalog over the Hive catalog? What happens when you roll back a Paimon table to an earlier tag? How does Paimon achieve streaming-batch unification on the same table? Why does Paimon recommend keeping bucket data size between 200MB and 1GB? What is the difference between the First Row and Deduplicate merge engines? How can you optimize query performance using the read-optimized system table? What is the difference between Paimon's and Apache Iceberg's core design philosophy? Why did Apache Paimon originally start as part of the Flink project, and what is it called now? Which is better and why: lookup or full-compaction changelog producer for a 30-minute-latency pipeline? How do you troubleshoot duplicate rows appearing when using Dynamic Bucket mode with multiple concurrent write jobs?
Show more question and Answers...

Database

Comments & Discussions

Interviews Questions

About Javapedia.net

Javapedia.net is for Java and J2EE developers, technologist and college students who prepare of interview. Also this site includes many practical examples.

This site is developed using J2EE technologies by Steve Antony, a senior Developer/lead at one of the logistics based company.

Follow Javapedia updates

contact: javatutorials2016[at]gmail[dot]com

Kindly consider donating for maintaining this website. Thanks.

Copyright © 2026, javapedia.net, all rights reserved. · .

DMCA.com Protection Status