<p dir="auto"><strong>Apache Airflow version</strong>: 2.0.1 Git Version:.release:2.0.1+beb8af5ac6c438c29e2c186145115fb1334a3735</p>
<p dir="auto"><strong>Kubernetes version (if you are using kubernetes)</strong> (use <code class="notranslate">kubectl version</code>): 1.17.17-gke.2800</p>
<p dir="auto"><strong>Environment</strong>:</p>
<ul dir="auto">
<li><strong>Cloud provider or hardware configuration</strong>: GKE (Kubernetes)</li>
<li><strong>OS</strong> (e.g. from /etc/os-release): Debian GNU/Linux 10 (buster) - docker image python:3.8-slim-buster</li>
<li><strong>Kernel</strong> (e.g. <code class="notranslate">uname -a</code>): Linux bd0d5605654a 4.15.0-140-generic <a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="95539982" data-permission-text="Title is private" data-url="https://github.com/apache/airflow/issues/144" data-hovercard-type="issue" data-hovercard-url="/apache/airflow/issues/144/hovercard" href="https://github.com/apache/airflow/issues/144">#144</a>-Ubuntu SMP Fri Mar 19 14:12:35 UTC 2021 x86_64 GNU/Linux</li>
<li><strong>Install tools</strong>: pip</li>
<li><strong>Others</strong>: Python 3.8, Kubernetes Executor, Docker</li>
</ul>
<p dir="auto"><strong>What happened</strong>:<br>
Pod template contained non existing volume which caused pod to be impossible to run. The volume existed before but was deleted. Task in Airflow was also stuck at "queued".<br>
Even after clearing task these pods stayed stuck in container creating and it seems that they need to be manually deleted.</p>
<p dir="auto">Pods are stuck with</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="Unable to attach or mount volumes: unmounted volumes=[secret-volume], unattached volumes=[google-key airflow-logs secret-volume]: timed out waiting for the condition
MountVolume.SetUp failed for volume &quot;secret-volume&quot; : secret &quot;airflow-secret-14610&quot; not found"><pre class="notranslate"><code class="notranslate">Unable to attach or mount volumes: unmounted volumes=[secret-volume], unattached volumes=[google-key airflow-logs secret-volume]: timed out waiting for the condition
MountVolume.SetUp failed for volume "secret-volume" : secret "airflow-secret-14610" not found
</code></pre></div>
<p dir="auto">Configuration:</p>
<div class="snippet-clipboard-content notranslate position-relative overflow-auto" data-snippet-clipboard-copy-content="AIRFLOW__KUBERNETES__DELETE_WORKER_PODS=True
AIRFLOW__KUBERNETES__DELETE_WORKER_PODS_ON_FAILURE=True
"><pre class="notranslate"><code class="notranslate">AIRFLOW__KUBERNETES__DELETE_WORKER_PODS=True
AIRFLOW__KUBERNETES__DELETE_WORKER_PODS_ON_FAILURE=True

</code></pre></div>

<p dir="auto"><strong>What you expected to happen</strong>:<br>
I would expect Airflow to delete pods that are not possible to be created, at least after clearing the task.</p>

<p dir="auto"><strong>How to reproduce it</strong>:<br>
Create a pod template with a volume and later delete that volume without pausing DAGs</p>

<p dir="auto"><strong>Anything else we need to know</strong>:<br>
It happens all the time and pods are not being deleted.</p>
<p dir="auto">Hi Team,</p>
<p dir="auto">We have a requirement that we need to schedule a Airflow Job on last Thursday of every month.<br>
So basically we might have 4 or 5 Thursdays depends on the month.</p>
<p dir="auto">how can it be changed dynamically. i.e.: its 4th or 5th Thursday.</p>
<p dir="auto">We tried implementing with the below, but it didn't work<br>
We have scheduled it for schedule_interval= "45 01 * * 4L".</p>
<p dir="auto">We have raised to google support after multiple options and support team asked to raise the issue with Airflow team.</p>
<p dir="auto">Could you please help us with the requirement.</p>