title: DataBricks: dbutils.notebook.run() fails with job aborted but running the notebook individually works
body: <p>I have a notebook that runs many notebooks in order, along the lines of:</p>
  <pre><code>%python
  notebook_list = ['Notebook1', 'Notebook2']
      
  for notebook in notebook_list:
      print(f&quot;Now on Notebook: {notebook}&quot;)
      try:
          dbutils.notebook.run(f'{notebook}', 3600)
      except Exception as e:
          print(e)
          pass
  </code></pre>
  <p>When I run this notebook, I get job aborted exceptions amounting to the following:</p>
  <pre><code>Exceptions:
  (1): Task failed while writing rows,
  (2): Failed to execute user defined function (SQLDriverLocal$$$Lambda$1707/462935920: (string) =&gt; string)
  (3): No input widget named effective_dating is defined
  </code></pre>
  <p>For #2 -- I have no user defined functions; I only use Spark functions.</p>
  <p>For #3 -- The widget seems fine and I take it that it is just calling this as an error too because of the previous errors.</p>
  <p>However, if I run <code>Notebook1</code> or <code>Notebook2</code> (Run all button) individually, they run as expected.</p>
  <p>To make matters more intriguing, if I run the loop above for the <em>second</em> time, each notebook will run fine; but <strong>only after</strong> I run each individually.</p>
  <p>I would like to have a single notebook that runs many notebooks, rather than setup a pipeline to run each individual notebook on its own.</p>