BigData / Apache Airflow Interview Questions
What is the difference between a DAG Run and a Task Instance in Airflow?
A DAG Run is an instantiation of the whole DAG for a specific data interval (logical date). It tracks the overall execution state (running, success, failed) for that interval.
A Task Instance is a specific execution of one task within a DAG Run. Each task instance belongs to exactly one DAG Run and has its own state (queued, running, success, failed, skipped, etc.).
Relationship: one DAG Run contains many Task Instances — one per task defined in the DAG.
More Related questions...