BigData / Apache Airflow Interview Questions
What is a TaskGroup in Airflow?
TaskGroups are a UI grouping mechanism for tasks introduced in Airflow 2.0. They collapse a set of related tasks into a single expandable node in the Graph view, making complex DAGs easier to read. Unlike SubDAGs, TaskGroups don't create a separate DAG object — they are purely visual.
from airflow.utils.task_group import TaskGroup with DAG('etl_dag', ...) as dag: with TaskGroup('extract_group') as extract: t1 = BashOperator(task_id='extract_a', bash_command='...') t2 = BashOperator(task_id='extract_b', bash_command='...') load = BashOperator(task_id='load', bash_command='...') extract >> load
More Related questions...