BigData / Apache Airflow Interview Questions
What is the KubernetesPodOperator in Airflow?
The KubernetesPodOperator runs any command inside a Docker container launched as a Kubernetes pod. It is independent of the executor type — even with CeleryExecutor you can use KubernetesPodOperator to run specific tasks in isolated pods.
from airflow.providers.cncf.kubernetes.operators.pod import KubernetesPodOperator run_etl = KubernetesPodOperator( task_id='run_etl', name='etl-pod', namespace='airflow', image='myrepo/etl:latest', cmds=['python', 'etl.py'], arguments=['--date', '{{ ds }}'], get_logs=True, is_delete_operator_pod=True )
This is useful for tasks that need specific dependencies, GPU access, or custom environments not available in the standard worker image.
More Related questions...