title: Data Lineage in SQL Server
body: <p>Objective : </p>
  
  <p>Let's think of a large scale enterprise where we have a heterogeneous data stores such as SQL servers, No-SQL stores, Big data stores like ADL, ADF..etc spreads across different business groups.</p>
  
  <p>Our objective is to build a lineage service at an enterprise level, which will provide insights on the data lineage between different data store instances within an enterprise. This will help us in gaining insights on the data proliferation within the enterprise.  </p>
  
  <p>For this, as a phase 1 we want to take SQL server and want to build the lineage within and across SQL servers and It's databases. </p>
  
  <p>Is there a way we can build / extract (if available) the data lineage (table &amp; Column level) from a SQL server by leveraging SQL profiling or transaction logs within or across instances. </p>
  
  <p>I looked at <a href="https://msdn.microsoft.com/en-gb/library/ff877969(v=SQL.110).aspx" rel="nofollow noreferrer">Determining Impact and Data Lineage</a> and looks like the SQL server should have the <a href="https://msdn.microsoft.com/en-gb/library/ff877992(v=sql.110).aspx" rel="nofollow noreferrer">Dependency Services</a> enabled. </p>
  
  <p>As a enterprise level service, I may have access to the SQL Servers and may not have control over the sql server instances on enabling any services.</p>
  
  <p>Could anyone share any insights or experiences with respect to building or extracting Data Lineage within or across SQL Servers. </p>
  
  <p>Thanks in Advance !</p>
  
  <p>Mydeen</p>