Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase

Books on implementing data lineage Expand / Collapse
Author
Message
Posted Tuesday, June 24, 2014 2:50 PM


SSC-Enthusiastic

SSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-Enthusiastic

Group: General Forum Members
Last Login: Friday, July 4, 2014 3:04 PM
Points: 146, Visits: 477
Hi,

We are currently working on implementing the data lineage within our data warehouse and I don't seem to find a book that really covers this subject. I have checked the 2012 certification PDF and few other books with no success.
I know that there are tools that are used for implementing the lineage and audit data, but we would like to create a db to contain the metadata(mainly for completeness and accuracy). Is there any book that covers this subject in detail?

Thanks a lot!
Post #1585682
Posted Wednesday, June 25, 2014 7:26 AM
SSC Eights!

SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!

Group: General Forum Members
Last Login: Yesterday @ 11:27 AM
Points: 802, Visits: 1,983
I have also looked and not been able to find anything. And although in general I'm a big fan of Ralph Kimball's books, I find it disappointing that he talks about the importance of lineage without making any practical suggestions to go about doing that.


Post #1585889
Posted Thursday, June 26, 2014 12:20 PM
SSC Veteran

SSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC Veteran

Group: General Forum Members
Last Login: Wednesday, July 2, 2014 3:59 PM
Points: 213, Visits: 572
Some ETL tools such as Informatica have data lineage built in. To my knowledge, SSIS does not. You'll have to either build on SSIS's auditing features or maybe find a third-party add on.
Post #1586606
Posted Thursday, July 3, 2014 3:19 PM


SSC-Enthusiastic

SSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-Enthusiastic

Group: General Forum Members
Last Login: Friday, July 4, 2014 3:04 PM
Points: 146, Visits: 477
Hi,

Thank you for the replies. Our workflows are made in informatica, but for the lineage info they ask for extra money, so we need to do it ourselves .
We will eventually do it step by step and improve it as we go along.
Basically we created a metadata db that will be populated from the informatica workflows.
If I find anything useful, I will post it here, but I'm not very optimist.

Post #1589141
« Prev Topic | Next Topic »

Add to briefcase

Permissions Expand / Collapse