title: How can I register a specific version of a Delta Table in Azure Machine Learning Studio from Azure ADLS Gen 1?
body: <p>I created a Delta Table in ADLS Gen 1 with the following code in Databricks:</p>
  <pre><code>df.write.format(&quot;delta&quot;).mode(&quot;overwrite&quot;).saveAsTable(&quot;db.my_tbl&quot;, path ='adl://organisation.azuredatalakestore.net/folder_name/my_data')
  </code></pre>
  <p>Sometimes, I re-run the code above to generate a new version of the <code>my_tbl</code> table. As usual with delta tables, a history is build and it must regulary be optimized and vaccumed. Now, I am often retraining a ML Model in Azure Machine Learning Studio and am wondering if it possible to register a specific version of the delta table?</p>
  <p>Currently, even after vaccuming, all my delta files (including older versions) are registered in Azure ML Studio when reading the parquet files from <code>my_data</code> folder! That is because I can not lower the retention period of the delta table below 168h except turning of <code>spark.databricks.delta.retentionDurationCheck.enabled</code>. I do not want to turn it off.</p>
  <p>I register my dataset through the ML Studio Interface as a File Dataset (not Tabular Dataset). This registration looks like this:</p>
  <p><a href="https://i.stack.imgur.com/iVd0U.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/iVd0U.png" alt="enter image description here" /></a></p>
  <p>Right now I see only the option to create a copy of <code>my_data</code> and reading it instead. Is there another way? Do you know if I can specify something in the path to point to the &quot;right&quot; .parquet files (belonging to a specific delta table version)?</p>