By Tim van de Keer/ on 23 Oct, 2020
This post shows how to leverage the power of Kubernetes for Airflow in three different ways.
- Using the Airflow KubernetesPodOperator from within your DAG’s
- Using the KubernetesExecutor to run task in your DAG’s natively on Kubernetes
- Using KEDA (Kubernetes Event Driven Autoscaler) together with Celery
Code examples and a video reference are included!...Read more