title: Integration of Kubernetes with Apache Airflow
body: <p>We are building workflow scheduling application. We found Airflow as a good option for workflow manager and Kubernetes as good option for Cluster manager. Thus, flow would be, </p>
  
  <ol>
  <li>We will submit workflow DAG to Airflow.</li>
  <li>Airflow should submit the tasks of a given DAG to Kubernetes by specifying docker image.</li>
  <li>Kubernetes should execute the task by running docker container on an available EC2 worker node of a cluster. </li>
  </ol>
  
  <p>On searching, we found, Airflow has Operators for integrating with ECS, Mesos but not for Kubernetes. However, we found a request for Kubernetes Operator on <a href="https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=71013666" rel="noreferrer">Airflow wiki</a>, but not any further update on it. </p>
  
  <p>So, the question to be simply put is, how to integrate Airflow with Kubernetes?</p>