BigData / Apache Airflow Interview Questions
What is the Airflow Scheduler?
The Airflow Scheduler is a core component that monitors DAGs and triggers task instances when their dependencies are met and the schedule interval fires. It continuously parses DAG files, checks the DAG schedule and any data interval conditions, and submits tasks to the executor for running.
Key points about the scheduler:
- Reads DAG files from the configured
dags_folder. - Creates DagRuns and TaskInstances in the metadata database.
- Does not execute tasks itself — it delegates that to the Executor.
- Runs continuously as a background process.
Does the Airflow Scheduler directly execute tasks?
More Related questions...
