BigData / Apache Airflow Interview Questions
How does Airflow handle templating and macros?
Airflow supports Jinja2 templating inside operator parameters that are listed in template_fields. You can inject runtime values such as execution date, data interval, and custom macros.
Common built-in macros:
{{ ds }}— execution date asYYYY-MM-DD.{{ ds_nodash }}— execution date without dashes.{{ data_interval_start }}/{{ data_interval_end }}— start/end of the data interval.{{ var.value.my_var }}— an Airflow Variable value.{{ conn.my_conn_id.host }}— a Connection attribute.
BashOperator( task_id='print_date', bash_command='echo Processing date: {{ ds }}' )
More Related questions...