title: Is there a limit to how many requests can be sent to Azure Data Lake (gen 1)?
body: <p>I have a pipeline in Azure Data Factory that moves data from Google BigQuery(GBQ) to Azure Data Lake (gen 1) and in between does some cleaning in Azure Databricks.</p>
  <p><a href="https://i.stack.imgur.com/8luKC.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/8luKC.png" alt="pipeline image" /></a></p>
  <p>The first copy activity copies data from GBQ to Data lake, then the data goes through Databricks, and finally, the last activity copies the data to a blob container.</p>
  <p>Out of the 4 initial copy activities, one randomly fails with the following error</p>
  <blockquote>
  <p>Failure happened on 'Sink' side.
  ErrorCode=UserErrorAdlsFileWriteFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Writing
  to 'AzureDataLakeStore' failed. Path:
  /.../.../PageTracking_06072021.csv. Message: The remote server
  returned an error: (403) Forbidden.. Response details:
  {&quot;RemoteException&quot;:{&quot;exception&quot;:&quot;AccessControlException&quot;,&quot;message&quot;:&quot;
  [......] Access Denied :
  /../../PageTracking_06072021.csv[.....]&quot;,&quot;javaClassName&quot;:&quot;org.apache.hadoop.security.AccessControlException&quot;}},Source=Microsoft.DataTransfer.ClientLibrary,''Type=System.Net.WebException,Message=The
  remote server returned an error: (403) Forbidden.,Source=System,'</p>
  </blockquote>
  <p>When I run the pipeline again, the failed one succeeds and others fail with the same error.</p>
  <p><strong>What I have tried so far.</strong></p>
  <p>Tried deleting the files and running fresh, but the first time everything succeeds and the cycle repeats itself.
  Tried changing the sequence of activities (like you see in the image). I still get the same error randomly.</p>
  <p>Access cannot be the issue because the same IR and configuration are being used in all the activities.</p>
  <p><strong>Update:</strong></p>
  <p>I have set up a trigger (once daily) for the pipeline and the pipeline runs fine. The problem happens only when I try to run the pipeline manually.</p>