title: Airflow not creating log files or showing logs in task instance on UI
body: <p>Im getting the following airflow issue:</p>
  <p>When I run Dags that have mutiple tasks in it, randomly airflow set some of the tasks to failed state, and also doesn't show any logs on the UI. I went to my running worker container and saw that the log files for those failed tasks were also not created.</p>
  <p>Going to Celery Flower, I found these logs on failed tasks:</p>
  <pre><code>airflow.exceptions.AirflowException: Celery command failed on host
  </code></pre>
  <p>How to solve this?</p>
  <p><a href="https://i.stack.imgur.com/6ICXj.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/6ICXj.png" alt="enter image description here" /></a>
  My environment is:</p>
  <ul>
  <li>airflow:2.3.1</li>
  <li>Docker compose</li>
  <li>Celery Executor</li>
  <li>Worker, webserver, scheduler and triggerer in different containers
  Docker compose hosted on Ubuntu</li>
  </ul>
  <p>I also saw this <a href="https://stackoverflow.com/a/69201032/11949273">https://stackoverflow.com/a/69201032/11949273</a> answer that might be related.</p>
  <p>Anyone with these same issues?</p>
  <p>Edit:</p>
  <p>On my EC2 Instance I got more vCPU's and fine tuned airflow/celery workers parameters and solved this. Probably is some issue with lack of CPU and or something else.</p>