title: Validation checks on dataset ADF vs databricks
body: <p>I want to perform some file level, field level validation checks on the dataset I receive.</p>
  <p>Given below some checks which I want to perform and capture any issues into audit tables.</p>
  <ul>
  <li>File Level Checks: File present, size of the file, Count of records matches to count present in control file</li>
  <li>Field Level checks: Content in right format, Duplicate key checks, range in important fields.</li>
  </ul>
  <p>I want to make this as a template so that all the project can adopt it, Is it good to perform these checks in ADF or in Databricks. If it is ADF any reference to example dataflow/pipeline would be very helpful.</p>
  <p>Thanks,
  Kumar</p>