Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase

Extracted Data Expand / Collapse
Author
Message
Posted Tuesday, June 16, 2009 12:43 AM
Forum Newbie

Forum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum Newbie

Group: General Forum Members
Last Login: Tuesday, August 11, 2009 6:16 AM
Points: 8, Visits: 38
Is there a way to tell that whether or not the extracted data from database is correct?
How to make sure the data extracted from database is accurate and correct?
Post #735476
Posted Tuesday, June 16, 2009 1:05 AM


SSCertifiable

SSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiable

Group: General Forum Members
Last Login: Today @ 4:15 PM
Points: 7,155, Visits: 13,215
Hi,

AFAIK there are no "correct" data within a database. Data can (and should/must) be valid and consistant. But that does not mean they have to be "correct" from users perspective, since there is no such general definition.

If the data you receive from a database are considered "incorrect", multiple reason can apply, e.g.
1) wrong (manual) data input (AKA garbage in = garbage out)
2) poor database design not forcing/checking for data being valid/consistant
3) timing problems for data manipulation (usually together with (2) )
4) corrupted database
5) wrong expectation from end user side ("Data have to show we're making profit! Why doesn't it?")

Just to name some of them...

If you'd describe a little more detailed what problem you're facing the answers might also be alittle more specific.

For details on how to post sample data please see the link in my signature.




Lutz
A pessimist is an optimist with experience.

How to get fast answers to your question
How to post performance related questions
Links for Tally Table , Cross Tabs and Dynamic Cross Tabs , Delimited Split Function
Post #735485
Posted Tuesday, June 16, 2009 1:09 AM


SSCertifiable

SSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiable

Group: General Forum Members
Last Login: 2 days ago @ 2:06 PM
Points: 5,047, Visits: 11,797
Extracted to what? A CSV file?

Do you mean some sort of verification process? What is your concern - is it that records get missed, or data somehow gets corrupted?



Help us to help you. For better, quicker and more-focused answers to your questions, consider following the advice in this link.

When you ask a question (and please do ask a question: "My T-SQL does not work" just doesn't cut it), please provide enough information for us to understand its context.
Post #735488
Posted Tuesday, June 16, 2009 4:16 PM
Hall of Fame

Hall of FameHall of FameHall of FameHall of FameHall of FameHall of FameHall of FameHall of FameHall of Fame

Group: General Forum Members
Last Login: Tuesday, August 19, 2014 10:01 AM
Points: 3,844, Visits: 3,841
I'm having trouble following you as well. You'll need to tell us a bit more about what you are trying to do. How is the data being extracted and to where? What makes the extracted data correct, incorrect?



John Rowan

======================================================
======================================================
Forum Etiquette: How to post data/code on a forum to get the best help - by Jeff Moden
Post #736082
Posted Tuesday, June 16, 2009 6:46 PM
Forum Newbie

Forum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum Newbie

Group: General Forum Members
Last Login: Tuesday, August 11, 2009 6:16 AM
Points: 8, Visits: 38
It is not a problem or corrupted data. Just want to know whether or not there is a way to tell my extracted data is correct. Any opinions? For example, I write the query based on customer's requirement and follow all the rules to extract the data from database. So, if someone ask me this question, what is the best way to address this type of question?
Post #736132
Posted Tuesday, June 16, 2009 8:25 PM


SSCertifiable

SSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiable

Group: General Forum Members
Last Login: 2 days ago @ 2:06 PM
Points: 5,047, Visits: 11,797
Define what you mean by 'correct'.


Help us to help you. For better, quicker and more-focused answers to your questions, consider following the advice in this link.

When you ask a question (and please do ask a question: "My T-SQL does not work" just doesn't cut it), please provide enough information for us to understand its context.
Post #736147
Posted Tuesday, June 16, 2009 8:32 PM
Forum Newbie

Forum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum Newbie

Group: General Forum Members
Last Login: Tuesday, August 11, 2009 6:16 AM
Points: 8, Visits: 38
correct -customer expected data, eg 1000 records in a report.
Not the content of the data.
Post #736149
Posted Wednesday, June 17, 2009 9:32 AM
Hall of Fame

Hall of FameHall of FameHall of FameHall of FameHall of FameHall of FameHall of FameHall of FameHall of Fame

Group: General Forum Members
Last Login: Tuesday, August 19, 2014 10:01 AM
Points: 3,844, Visits: 3,841
If it is row counts that you are concernted about, you could create an audit/history table of sorts that you can use to insert 1 row for each time your SSIS package executes. Use SSIS to capture the row counts for rows output to your destination file and then include the row counts as a column in your table.

If it is more than row counts that make the data 'correct', you'll need to define what those requirements are.




John Rowan

======================================================
======================================================
Forum Etiquette: How to post data/code on a forum to get the best help - by Jeff Moden
Post #736719
Posted Wednesday, June 17, 2009 1:24 PM


SSCertifiable

SSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiable

Group: General Forum Members
Last Login: Today @ 4:15 PM
Points: 7,155, Visits: 13,215
What happens if the resulting number of rows after applying selection criteria will be less than 1000?
Would that make the result incorrect?
Sounds like a very strange requirement/criteria to me...
To "prove" that the SSIS package returns all rows that match the search criteria you could run the select statement used in your SSIS package directly against the database using SSMS (if that's possible) and compare the results. Is that what you're looking for?




Lutz
A pessimist is an optimist with experience.

How to get fast answers to your question
How to post performance related questions
Links for Tally Table , Cross Tabs and Dynamic Cross Tabs , Delimited Split Function
Post #736915
« Prev Topic | Next Topic »

Add to briefcase

Permissions Expand / Collapse