September 25, 2012 at 5:11 pm
In terms of SQL, what does it mean by sanitize the data....I read couple of article and have some idea but I need to hear from experienced folks about this topic.
Thanks,
SueTons.
Regards,
SQLisAwe5oMe.
September 25, 2012 at 5:23 pm
Data sanitization is removal of garbage data inbound to the system. It covers a number of smaller minor topics but basically it's a pre-check of the data prior to system entry to make sure it won't break it.
This can include checking all data conforms to existing foreign keys, columns didn't get misplaced in the source and alpha data won't try to enter numeric columns, data isn't older than a certain point and/or isn't repeats of existing data, and similar items.
It just basically means cleaning it up before it enters the system, and possibly reporting on the bad hits for user repair via a secondary method.
Never stop learning, even if it hurts. Ego bruises are practically mandatory as you learn unless you've never risked enough to make a mistake.
For better assistance in answering your questions[/url] | Forum Netiquette
For index/tuning help, follow these directions.[/url] |Tally Tables[/url]
Twitter: @AnyWayDBA
September 25, 2012 at 5:35 pm
Evil Kraig F (9/25/2012)
Data sanitization is removal of garbage data inbound to the system. It covers a number of smaller minor topics but basically it's a pre-check of the data prior to system entry to make sure it won't break it.This can include checking all data conforms to existing foreign keys, columns didn't get misplaced in the source and alpha data won't try to enter numeric columns, data isn't older than a certain point and/or isn't repeats of existing data, and similar items.
It just basically means cleaning it up before it enters the system, and possibly reporting on the bad hits for user repair via a secondary method.
What about when you refresh the production data to dev server, during that process I know there is data sanitation involved but in out environment, it is done by IT support team so, I am not sure what exactly they do, so, I was wondering if any of you had experience on that.
Thanks,
SueTons
Regards,
SQLisAwe5oMe.
September 25, 2012 at 5:42 pm
SQLCrazyCertified (9/25/2012)
What about when you refresh the production data to dev server, during that process I know there is data sanitation involved but in out environment, it is done by IT support team so, I am not sure what exactly they do, so, I was wondering if any of you had experience on that.Thanks,
SueTons
Oh! Lessons in context... 😀
Sanitizing data during transfer to less secure systems is to break or remove confidential information for a wider distribution.
Examples:
Scramble Credit Card Numbers
Scramble SSNs
Relocate First/Last Names (Medical in particular here) from originating data (order scramble)
Reset all passwords to paSSw0rd
Remove all salary information in HR database. Possibly all address information as well.
...
Basically, anything a dev doesn't need to know, particularly in bulk. Production systems have massive audit and access requirements for a reason, and as frustrating as it is to me it's not to disallow me access to figure out a problem and keep the DBA's employed. A simple select off a Creditcard table gives any identity thief enough information to work from to live in the Riviera for years. Sanitization in this case means that no usable data (or illegal, depending on what's in there and HIPAA/SEC) makes it into the hands of the unaudited.
Never stop learning, even if it hurts. Ego bruises are practically mandatory as you learn unless you've never risked enough to make a mistake.
For better assistance in answering your questions[/url] | Forum Netiquette
For index/tuning help, follow these directions.[/url] |Tally Tables[/url]
Twitter: @AnyWayDBA
September 25, 2012 at 6:55 pm
Thanks....Appreciate it.
SueTons.
Regards,
SQLisAwe5oMe.
Viewing 5 posts - 1 through 4 (of 4 total)
You must be logged in to reply to this topic. Login to reply