BigData / Apache Airflow Interview Questions
What is the Airflow metadata database and what does it store?
The metadata database (metastore) is a relational database (PostgreSQL or MySQL recommended for production; SQLite for local testing) that is the central state store for Airflow. It persists:
- DAG definitions and schedules
- DAG Runs and their states
- Task Instances and their states, logs, and XCom values
- Connections and Variables
- User accounts and RBAC roles (when auth is enabled)
- Pool and slot usage
The database schema is managed through Alembic migrations and upgraded via airflow db upgrade.
More Related questions...