title: Reading shared global dataframe in dask
body: <p>I'm parallelizing a function over 32 cores and am having some trouble accessing a shared dataframe <code>dask_paths</code>. All the code works correctly when I get rid of the line (and lines that depend on it) <code>dask_paths[dask_paths['od'] == (o,d)].compute()</code>. Incredibly, if I compute this for some fixed <code>o, d</code> <em>outside</em> of the distributed code, then use <em>that</em> result, I get what I want (for that <code>o, d</code>). This means it really is just the actual accessing of <code>dask_paths</code> that is failing in the parallel computation. I am using the logic given <a href="https://examples.dask.org/applications/embarrassingly-parallel.html" rel="nofollow noreferrer">here</a> for &quot;embarassingly paralellizable for loops&quot; in the dask docs. Moreover, I used to use <code>get_group</code> on a global <code>pd.DataFrame</code> <code>grouped</code> for this logic, and that suffered from the same problem of glogbal (even though this is serially done in a couple seconds, the computation stalls before giving a cryptic error message, given at the bottom). I don't know why this is.</p>
  <p>Note that <code>dask_paths</code> is a <code>Dask.dataframe</code>. This is the most basic of logic in parallellizing with <code>dask</code>, so not sure why it's failing. I am working on a Vertex AI jupyter notebook on Google Cloud. There is no error trace, because the program simply stalls. All the data/dataframes have been defined in the global environment of the jupyter notebook in the cells above, and are working fine. The vertex AI notebook has 16 vCPUs and 100GB RAM and is run on Google Cloud's VM. There is no reading or writing to any files, so that's not the issue.</p>
  <pre><code># dask_paths['od'] takes on values like (100, 150)
  # popular takes the form of a [[20, 25], [100, 150], [67, 83],...]
     # and is of length 2000 elements, every element is a list of len 2
  def main():
      def pop2unique(pop): 
          df = dask_paths[dask_paths['od'] == (pop[0], pop[1])].compute()
          return df['last'].sum()
          
      lzs = []
      ncores = 32 
      dask_client.cluster.scale(10)
  
      futures = dask_client.map(pop2unique, popular[:10]) # this stalls 
      results = dask_client.gather(futures)
  </code></pre>
  <p>And <code>dask_paths</code> takes the form</p>
  <pre><code>index       (o, d)       last
  605096     (22, 25)       10
  999336     (103, 88)      31
  1304512    (101, 33)      9
  1432383    (768, 21)      16
  </code></pre>
  <p>The <code>client</code> being used everywhere is given by</p>
  <pre><code>from dask.distributed import Client, progress
  dask_client = Client(threads_per_worker=4, n_workers=8)
  </code></pre>
  <p>The error message I get is long and cryptic:</p>
  <pre><code>distributed.diskutils - INFO - Found stale lock file and directory '/home/jupyter/dask-worker-space/worker-9y17gy_r', purging
  distributed.scheduler - WARNING - Worker tried to connect with a duplicate name: 33
  distributed.scheduler - WARNING - Worker tried to connect with a duplicate name: 35
  distributed.nanny - ERROR - Failed to start worker
  Traceback (most recent call last):
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 884, in run
      await worker
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/core.py&quot;, line 279, in _
      await self.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1584, in start
      await self._register_with_scheduler()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1299, in _register_with_scheduler
      raise ValueError(f&quot;Unexpected response from register: {response!r}&quot;)
  ValueError: Unexpected response from register: {'status': 'error', 'message': 'name taken, 33', 'time': 1658860560.8544912}
  distributed.scheduler - WARNING - Worker tried to connect with a duplicate name: 36
  distributed.scheduler - WARNING - Worker tried to connect with a duplicate name: 31
  distributed.nanny - ERROR - Failed to start worker
  Traceback (most recent call last):
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 884, in run
      await worker
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/core.py&quot;, line 279, in _
      await self.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1584, in start
      await self._register_with_scheduler()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1299, in _register_with_scheduler
      raise ValueError(f&quot;Unexpected response from register: {response!r}&quot;)
  ValueError: Unexpected response from register: {'status': 'error', 'message': 'name taken, 35', 'time': 1658860560.8563268}
  distributed.nanny - ERROR - Failed to start worker
  Traceback (most recent call last):
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 884, in run
      await worker
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/core.py&quot;, line 279, in _
      await self.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1584, in start
      await self._register_with_scheduler()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1299, in _register_with_scheduler
      raise ValueError(f&quot;Unexpected response from register: {response!r}&quot;)
  ValueError: Unexpected response from register: {'status': 'error', 'message': 'name taken, 36', 'time': 1658860560.8576422}
  distributed.scheduler - WARNING - Worker tried to connect with a duplicate name: 34
  distributed.nanny - ERROR - Failed to start worker
  Traceback (most recent call last):
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 884, in run
      await worker
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/core.py&quot;, line 279, in _
      await self.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1584, in start
      await self._register_with_scheduler()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1299, in _register_with_scheduler
      raise ValueError(f&quot;Unexpected response from register: {response!r}&quot;)
  ValueError: Unexpected response from register: {'status': 'error', 'message': 'name taken, 31', 'time': 1658860560.8595085}
  distributed.scheduler - WARNING - Worker tried to connect with a duplicate name: 32
  distributed.nanny - ERROR - Failed to start worker
  Traceback (most recent call last):
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 884, in run
      await worker
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/core.py&quot;, line 279, in _
      await self.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1584, in start
      await self._register_with_scheduler()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1299, in _register_with_scheduler
      raise ValueError(f&quot;Unexpected response from register: {response!r}&quot;)
  ValueError: Unexpected response from register: {'status': 'error', 'message': 'name taken, 34', 'time': 1658860560.8609138}
  distributed.nanny - ERROR - Failed to start worker
  Traceback (most recent call last):
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 884, in run
      await worker
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/core.py&quot;, line 279, in _
      await self.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1584, in start
      await self._register_with_scheduler()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1299, in _register_with_scheduler
      raise ValueError(f&quot;Unexpected response from register: {response!r}&quot;)
  ValueError: Unexpected response from register: {'status': 'error', 'message': 'name taken, 32', 'time': 1658860560.862359}
  distributed.nanny - ERROR - Failed while trying to start worker process: Unexpected response from register: {'status': 'error', 'message': 'name taken, 36', 'time': 1658860560.8576422}
  distributed.nanny - ERROR - Failed while trying to start worker process: Unexpected response from register: {'status': 'error', 'message': 'name taken, 31', 'time': 1658860560.8595085}
  distributed.nanny - ERROR - Failed while trying to start worker process: Unexpected response from register: {'status': 'error', 'message': 'name taken, 35', 'time': 1658860560.8563268}
  distributed.nanny - ERROR - Failed while trying to start worker process: Unexpected response from register: {'status': 'error', 'message': 'name taken, 33', 'time': 1658860560.8544912}
  distributed.nanny - ERROR - Failed while trying to start worker process: Unexpected response from register: {'status': 'error', 'message': 'name taken, 34', 'time': 1658860560.8609138}
  distributed.nanny - ERROR - Failed while trying to start worker process: Unexpected response from register: {'status': 'error', 'message': 'name taken, 32', 'time': 1658860560.862359}
  Task exception was never retrieved
  future: &lt;Task finished coro=&lt;_wrap_awaitable() done, defined at /opt/conda/lib/python3.7/asyncio/tasks.py:623&gt; exception=ValueError(&quot;Unexpected response from register: {'status': 'error', 'message': 'name taken, 32', 'time': 1658860560.862359}&quot;)&gt;
  Traceback (most recent call last):
    File &quot;/opt/conda/lib/python3.7/asyncio/tasks.py&quot;, line 630, in _wrap_awaitable
      return (yield from awaitable.__await__())
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/core.py&quot;, line 279, in _
      await self.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 334, in start
      response = await self.instantiate()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 417, in instantiate
      result = await self.process.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 694, in start
      msg = await self._wait_until_connected(uid)
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 812, in _wait_until_connected
      raise msg[&quot;exception&quot;]
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 884, in run
      await worker
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/core.py&quot;, line 279, in _
      await self.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1584, in start
      await self._register_with_scheduler()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1299, in _register_with_scheduler
      raise ValueError(f&quot;Unexpected response from register: {response!r}&quot;)
  ValueError: Unexpected response from register: {'status': 'error', 'message': 'name taken, 32', 'time': 1658860560.862359}
  Task exception was never retrieved
  future: &lt;Task finished coro=&lt;_wrap_awaitable() done, defined at /opt/conda/lib/python3.7/asyncio/tasks.py:623&gt; exception=ValueError(&quot;Unexpected response from register: {'status': 'error', 'message': 'name taken, 36', 'time': 1658860560.8576422}&quot;)&gt;
  Traceback (most recent call last):
    File &quot;/opt/conda/lib/python3.7/asyncio/tasks.py&quot;, line 630, in _wrap_awaitable
      return (yield from awaitable.__await__())
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/core.py&quot;, line 279, in _
      await self.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 334, in start
      response = await self.instantiate()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 417, in instantiate
      result = await self.process.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 694, in start
      msg = await self._wait_until_connected(uid)
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 812, in _wait_until_connected
      raise msg[&quot;exception&quot;]
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 884, in run
      await worker
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/core.py&quot;, line 279, in _
      await self.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1584, in start
      await self._register_with_scheduler()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1299, in _register_with_scheduler
      raise ValueError(f&quot;Unexpected response from register: {response!r}&quot;)
  ValueError: Unexpected response from register: {'status': 'error', 'message': 'name taken, 36', 'time': 1658860560.8576422}
  Task exception was never retrieved
  future: &lt;Task finished coro=&lt;_wrap_awaitable() done, defined at /opt/conda/lib/python3.7/asyncio/tasks.py:623&gt; exception=ValueError(&quot;Unexpected response from register: {'status': 'error', 'message': 'name taken, 35', 'time': 1658860560.8563268}&quot;)&gt;
  Traceback (most recent call last):
    File &quot;/opt/conda/lib/python3.7/asyncio/tasks.py&quot;, line 630, in _wrap_awaitable
      return (yield from awaitable.__await__())
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/core.py&quot;, line 279, in _
      await self.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 334, in start
      response = await self.instantiate()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 417, in instantiate
      result = await self.process.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 694, in start
      msg = await self._wait_until_connected(uid)
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 812, in _wait_until_connected
      raise msg[&quot;exception&quot;]
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 884, in run
      await worker
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/core.py&quot;, line 279, in _
      await self.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1584, in start
      await self._register_with_scheduler()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1299, in _register_with_scheduler
      raise ValueError(f&quot;Unexpected response from register: {response!r}&quot;)
  ValueError: Unexpected response from register: {'status': 'error', 'message': 'name taken, 35', 'time': 1658860560.8563268}
  Task exception was never retrieved
  future: &lt;Task finished coro=&lt;_wrap_awaitable() done, defined at /opt/conda/lib/python3.7/asyncio/tasks.py:623&gt; exception=ValueError(&quot;Unexpected response from register: {'status': 'error', 'message': 'name taken, 34', 'time': 1658860560.8609138}&quot;)&gt;
  Traceback (most recent call last):
    File &quot;/opt/conda/lib/python3.7/asyncio/tasks.py&quot;, line 630, in _wrap_awaitable
      return (yield from awaitable.__await__())
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/core.py&quot;, line 279, in _
      await self.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 334, in start
      response = await self.instantiate()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 417, in instantiate
      result = await self.process.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 694, in start
      msg = await self._wait_until_connected(uid)
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 812, in _wait_until_connected
      raise msg[&quot;exception&quot;]
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 884, in run
      await worker
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/core.py&quot;, line 279, in _
      await self.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1584, in start
      await self._register_with_scheduler()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1299, in _register_with_scheduler
      raise ValueError(f&quot;Unexpected response from register: {response!r}&quot;)
  ValueError: Unexpected response from register: {'status': 'error', 'message': 'name taken, 34', 'time': 1658860560.8609138}
  Task exception was never retrieved
  future: &lt;Task finished coro=&lt;_wrap_awaitable() done, defined at /opt/conda/lib/python3.7/asyncio/tasks.py:623&gt; exception=ValueError(&quot;Unexpected response from register: {'status': 'error', 'message': 'name taken, 33', 'time': 1658860560.8544912}&quot;)&gt;
  Traceback (most recent call last):
    File &quot;/opt/conda/lib/python3.7/asyncio/tasks.py&quot;, line 630, in _wrap_awaitable
      return (yield from awaitable.__await__())
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/core.py&quot;, line 279, in _
      await self.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 334, in start
      response = await self.instantiate()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 417, in instantiate
      result = await self.process.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 694, in start
      msg = await self._wait_until_connected(uid)
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 812, in _wait_until_connected
      raise msg[&quot;exception&quot;]
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 884, in run
      await worker
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/core.py&quot;, line 279, in _
      await self.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1584, in start
      await self._register_with_scheduler()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1299, in _register_with_scheduler
      raise ValueError(f&quot;Unexpected response from register: {response!r}&quot;)
  ValueError: Unexpected response from register: {'status': 'error', 'message': 'name taken, 33', 'time': 1658860560.8544912}
  Task exception was never retrieved
  future: &lt;Task finished coro=&lt;_wrap_awaitable() done, defined at /opt/conda/lib/python3.7/asyncio/tasks.py:623&gt; exception=ValueError(&quot;Unexpected response from register: {'status': 'error', 'message': 'name taken, 31', 'time': 1658860560.8595085}&quot;)&gt;
  Traceback (most recent call last):
    File &quot;/opt/conda/lib/python3.7/asyncio/tasks.py&quot;, line 630, in _wrap_awaitable
      return (yield from awaitable.__await__())
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/core.py&quot;, line 279, in _
      await self.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 334, in start
      response = await self.instantiate()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 417, in instantiate
      result = await self.process.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 694, in start
      msg = await self._wait_until_connected(uid)
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 812, in _wait_until_connected
      raise msg[&quot;exception&quot;]
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 884, in run
      await worker
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/core.py&quot;, line 279, in _
      await self.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1584, in start
      await self._register_with_scheduler()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1299, in _register_with_scheduler
      raise ValueError(f&quot;Unexpected response from register: {response!r}&quot;)
  ValueError: Unexpected response from register: {'status': 'error', 'message': 'name taken, 31', 'time': 1658860560.8595085}
  distributed.diskutils - INFO - Found stale lock file and directory '/home/jupyter/dask-worker-space/worker-xd5jxrin', purging
  distributed.diskutils - INFO - Found stale lock file and directory '/home/jupyter/dask-worker-space/worker-w_fmefrs', purging
  distributed.diskutils - INFO - Found stale lock file and directory '/home/jupyter/dask-worker-space/worker-djg8ki4m', purging
  distributed.diskutils - INFO - Found stale lock file and directory '/home/jupyter/dask-worker-space/worker-ho1hw10b', purging
  distributed.diskutils - INFO - Found stale lock file and directory '/home/jupyter/dask-worker-space/worker-mbdw10vg', purging
  distributed.diskutils - INFO - Found stale lock file and directory '/home/jupyter/dask-worker-space/worker-whk890cp', purging
  distributed.scheduler - WARNING - Worker tried to connect with a duplicate name: 32
  distributed.nanny - ERROR - Failed to start worker
  Traceback (most recent call last):
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 884, in run
      await worker
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/core.py&quot;, line 279, in _
      await self.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1584, in start
      await self._register_with_scheduler()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1299, in _register_with_scheduler
      raise ValueError(f&quot;Unexpected response from register: {response!r}&quot;)
  ValueError: Unexpected response from register: {'status': 'error', 'message': 'name taken, 32', 'time': 1658860564.692771}
  distributed.nanny - ERROR - Failed while trying to start worker process: Unexpected response from register: {'status': 'error', 'message': 'name taken, 32', 'time': 1658860564.692771}
  tornado.application - ERROR - Exception in callback functools.partial(&lt;bound method IOLoop._discard_future_result of &lt;zmq.eventloop.ioloop.ZMQIOLoop object at 0x7f82cf7eba10&gt;&gt;, &lt;Task finished coro=&lt;SpecCluster._correct_state_internal() done, defined at /opt/conda/lib/python3.7/site-packages/distributed/deploy/spec.py:310&gt; exception=ValueError(&quot;Unexpected response from register: {'status': 'error', 'message': 'name taken, 32', 'time': 1658860564.692771}&quot;)&gt;)
  Traceback (most recent call last):
    File &quot;/opt/conda/lib/python3.7/site-packages/tornado/ioloop.py&quot;, line 741, in _run_callback
      ret = callback()
    File &quot;/opt/conda/lib/python3.7/site-packages/tornado/ioloop.py&quot;, line 765, in _discard_future_result
      future.result()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/deploy/spec.py&quot;, line 348, in _correct_state_internal
      await w  # for tornado gen.coroutine support
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/core.py&quot;, line 279, in _
      await self.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 334, in start
      response = await self.instantiate()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 417, in instantiate
      result = await self.process.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 694, in start
      msg = await self._wait_until_connected(uid)
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 812, in _wait_until_connected
      raise msg[&quot;exception&quot;]
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/nanny.py&quot;, line 884, in run
      await worker
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/core.py&quot;, line 279, in _
      await self.start()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1584, in start
      await self._register_with_scheduler()
    File &quot;/opt/conda/lib/python3.7/site-packages/distributed/worker.py&quot;, line 1299, in _register_with_scheduler
      raise ValueError(f&quot;Unexpected response from register: {response!r}&quot;)
  ValueError: Unexpected response from register: {'status': 'error', 'message': 'name taken, 32', 'time': 1658860564.692771}
  </code></pre>