title: Using SQL Stored Procedure vs Databricks in Azure Data Factory
body: <p>I have a requirement to write upto 500k records daily to Azure SQL DB using an ADF pipeline.
  I had simple calculations as part of the data transformation that can performed in a SQL Stored procedure activity. I've also observed Databricks Notebooks being used commonly, esp. due to benefits of scalability going forward. But there is an overhead activity of placing files in another location after transformation, managing authentication etc. and I want to avoid any over-engineering unless absolutely required.
  I've tested SQL Stored Proc and it's working quite well for ~50k records (not yet tested with higher volumes).</p>
  <p>But I'd still like to know the general recommendation between the 2 options, esp. from experienced Azure or data engineers.
  Thanks</p>