title: InternalServerError: We encountered an internal error. Please try again
body: <p>I encountered an error: &quot;Internal Server Error: We encountered an internal error. Please try again.&quot; when I run following script.</p>
  <p><strong>This error occurs suddenly after completed some tasks. Suddenly.</strong></p>
  <pre class="lang-py prettyprint-override"><code>from sagemaker.network import NetworkConfig
  from sagemaker.processing import ProcessingInput, ProcessingOutput, Processor
  
  processor = Processor(
      role=****,
      image_uri=****,
      instance_count=1,
      instance_type=&quot;m5.large&quot;,
      network_config=NetworkConfig(security_group_ids=[****], subnets=[****])
  )
  processor.run(
      inputs=[
          ProcessingInput(***),
      ],
      outputs=[
          ProcessingOutput(
              source=&quot;****&quot;,
              destination=&quot;****&quot;,
              s3_upload_mode=&quot;Continuous&quot;,
          )
      ]
  )
  </code></pre>
  <p>Stack trace is followings.</p>
  <pre><code>  File &quot;run_sagemaker.py&quot;, line 44, in process2
      processor.run(
    File &quot;/home/lubuntu/.miniconda/envs/sagemaker/lib/python3.8/site-packages/sagemaker/processing.py&quot;, line 165, in run
      self.latest_job.wait(logs=logs)
    File &quot;/home/lubuntu/.miniconda/envs/sagemaker/lib/python3.8/site-packages/sagemaker/processing.py&quot;, line 731, in wait
      self.sagemaker_session.logs_for_processing_job(self.job_name, wait=True)
    File &quot;/home/lubuntu/.miniconda/envs/sagemaker/lib/python3.8/site-packages/sagemaker/session.py&quot;, line 3167, in logs_for_processing_job
      self._check_job_status(job_name, description, &quot;ProcessingJobStatus&quot;)
    File &quot;/home/lubuntu/.miniconda/envs/sagemaker/lib/python3.8/site-packages/sagemaker/session.py&quot;, line 2666, in _check_job_status
      raise exceptions.UnexpectedStatusException(
  sagemaker.exceptions.UnexpectedStatusException: Error for Processing job ****: Failed. Reason: InternalServerError: We encountered an internal error.  Please try again.
  </code></pre>
  <p>But when I set s3_upload_mode=&quot;EndOfJob&quot;, this error didn't occur.</p>
  <p>My pc environment is</p>
  <ul>
  <li>lubuntu 20.04 LTS (work on VMWare Workstation Player)</li>
  <li>python 3.8.3</li>
  <li>sagemaker 1.69.0</li>
  <li>AWS region is Ohio (us-east-2)</li>
  </ul>
  <p>What is wrong for me?</p>
  <p>Please lend me your wisdom.</p>