Clean Data

  • Dave62

    SSCertifiable

    Points: 6269

    Comments posted to this topic are about the item Clean Data

  • Rune Bivrin

    SSCertifiable

    Points: 7536

    Great question!

    I've never used DQS, but the correct answer just seemed the most logical.


    Just because you're right doesn't mean everybody else is wrong.

  • sqlnaive

    SSCoach

    Points: 17435

    Wow. It was just shot correctly in the dark. I am not aware of DQS. But curiousity made me look out for it, got some idea and hit the correct answer. Would love to learn a little more about it. Thanks for introducing totally new thing to me. 🙂

  • Richard Warr

    SSCertifiable

    Points: 6955

    I use DQS quite a lot and those steps don't bear much relation to what you do.

    1) Create/Map Knowledge Base

    2) Create DQ Project

    3) Run project to cleanse data

    is more like it.

    There is a "Configuration" option but it's not always necessary.

    _____________________________________________________________________
    MCSA SQL Server 2012

  • Koen Verbeeck

    SSC Guru

    Points: 258905

    Nice question about a pretty unknown product. Thanks.

    Need an answer? No, you need a question
    My blog at https://sqlkover.com.
    MCSE Business Intelligence - Microsoft Data Platform MVP

  • Ed Wagner

    SSC Guru

    Points: 286957

    I've never used it, but it looks like it might be something we could use. Thanks for the introduction to a product I know nothing about.

  • Sai Reddy

    SSC Veteran

    Points: 249

    QOTD is really a good platform to learn many new things we never even knew existed in SQL Server. One good one (DQS) I learned today again. Thanks a lot for this service.

  • Dana Medley

    SSCertifiable

    Points: 6764

    Thanks for the question. I definitely learned something today.



    Everything is awesome!

  • sneumersky

    SSCertifiable

    Points: 7667

    For more info on using DQS, MDS (Master Data Services), and SSIS together check out the White Paper/Tutorial:

    Enterprise Information Management (EIM) using SSIS, MDS, and DQS together:

    http://www.microsoft.com/en-us/download/details.aspx?id=35462

    Data Quality Services Performance Best Practices:

    http://www.microsoft.com/en-us/download/details.aspx?id=29075

    Cleanse and Match Data by using EIM:

    http://msdn.microsoft.com/en-us/library/jj836269.aspx

    These products all compliment each other.

  • Thomas Abraham

    SSChampion

    Points: 10761

    sqlnaive (8/20/2013)


    Wow. It was just shot correctly in the dark. I am not aware of DQS. But curiousity made me look out for it, got some idea and hit the correct answer. Would love to learn a little more about it. Thanks for introducing totally new thing to me. 🙂

    +1 Never have used this, and the excuse to go learn about it was well work it. Thanks for the question.

    [font="Verdana"]Please don't go. The drones need you. They look up to you.[/font]
    Connect to me on LinkedIn

  • Hugo Kornelis

    SSC Guru

    Points: 64645

    Koen Verbeeck (8/20/2013)


    Nice question about a pretty unknown product. Thanks.

    Heh! I've seen demo's of DQS, and of all the adjectives one could use to describe it, "pretty" would be pretty much at the bottom of the list. The user interface qualifies among the ugliest I have seen (though even that pales in comparison to the user experience of actually trying to do work with DQS).

    However, I do agree with "unknown". 😉


    Hugo Kornelis, SQL Server/Data Platform MVP (2006-2016)
    Visit my SQL Server blog: https://sqlserverfast.com/blog/
    SQL Server Execution Plan Reference: https://sqlserverfast.com/epr/

  • TomThomson

    SSC Guru

    Points: 104762

    Richard Warr (8/20/2013)


    I use DQS quite a lot and those steps don't bear much relation to what you do.

    1) Create/Map Knowledge Base

    2) Create DQ Project

    3) Run project to cleanse data

    is more like it.

    There is a "Configuration" option but it's not always necessary.

    Nice to see another of the features introduced in SQLS 2012 making an appearance in QOTD.

    I suspect that the question's first two steps are your first step, while the question's third step is your second and third; but I'm not at all sure, as I've done very little reading on the topic and I've never used this feature. I got it right because I had a vague recollection (quite probably incorrect) that there was something about first configuring the source of valid data, then creating a domain and populating it with that source, and then using the result to do the cleansing. The documentation for DQS at the conceptual level is (as it so often is for MS stuff) pretty abysmal, but probably the lower level documentation is rather better (or nobody would be able to use the feature). If the source is a provider that you subscribe to and have configured before, configuration is irrelevant because it's already been done, so the questions first step doesn't happen, and you go straight to creating a domain and mapping the data source to it; if you are providing the reference data by hand, there isn't any configuration to do as far as I understand it. So the apparent difference between the qotd and your experience is the real difference between two different sets of circumstances in which someone uses DQS.

    At least that's how I understand it - I could easily be completely wrong.

    edit: I've now seen Hugo's comment. The awfulness he describes may be one reason why the concept-level documentation is so utterly awful. I suppose I'll suffer it one day, but I shall be optimistic and assume I don't need to play with it until it's proven that I do.

    Tom

  • Ken Wymore

    SSCoach

    Points: 16354

    I got my choices backwards, oh well. Thanks for the question around a newer feature.

  • sqlnaive

    SSCoach

    Points: 17435

    I tried going through some of the docs but couldn't get it. Can someone brief me about what it does ??? Or any link providing the DQS functionality in it's simplest form will be appreciated.

  • Ken Wymore

    SSCoach

    Points: 16354

    sqlnaive (8/20/2013)


    I tried going through some of the docs but couldn't get it. Can someone brief me about what it does ??? Or any link providing the DQS functionality in it's simplest form will be appreciated.

    You might try this blog:

    http://www.bidn.com/blogs/cprice1979/ssas/2482/getting-started-with-data-quality-services-dqs-2012

Viewing 15 posts - 1 through 15 (of 20 total)

You must be logged in to reply to this topic. Login to reply