Clean Data

  • Comments posted to this topic are about the item Clean Data

  • Great question!

    I've never used DQS, but the correct answer just seemed the most logical.


    Just because you're right doesn't mean everybody else is wrong.

  • Wow. It was just shot correctly in the dark. I am not aware of DQS. But curiousity made me look out for it, got some idea and hit the correct answer. Would love to learn a little more about it. Thanks for introducing totally new thing to me. 🙂

  • I use DQS quite a lot and those steps don't bear much relation to what you do.

    1) Create/Map Knowledge Base

    2) Create DQ Project

    3) Run project to cleanse data

    is more like it.

    There is a "Configuration" option but it's not always necessary.

  • Nice question about a pretty unknown product. Thanks.

    Need an answer? No, you need a question
    My blog at https://sqlkover.com.
    MCSE Business Intelligence - Microsoft Data Platform MVP

  • I've never used it, but it looks like it might be something we could use. Thanks for the introduction to a product I know nothing about.

  • QOTD is really a good platform to learn many new things we never even knew existed in SQL Server. One good one (DQS) I learned today again. Thanks a lot for this service.

  • Thanks for the question. I definitely learned something today.



    Everything is awesome!

  • For more info on using DQS, MDS (Master Data Services), and SSIS together check out the White Paper/Tutorial:

    Enterprise Information Management (EIM) using SSIS, MDS, and DQS together:

    http://www.microsoft.com/en-us/download/details.aspx?id=35462

    Data Quality Services Performance Best Practices:

    http://www.microsoft.com/en-us/download/details.aspx?id=29075

    Cleanse and Match Data by using EIM:

    http://msdn.microsoft.com/en-us/library/jj836269.aspx

    These products all compliment each other.

  • sqlnaive (8/20/2013)


    Wow. It was just shot correctly in the dark. I am not aware of DQS. But curiousity made me look out for it, got some idea and hit the correct answer. Would love to learn a little more about it. Thanks for introducing totally new thing to me. 🙂

    +1 Never have used this, and the excuse to go learn about it was well work it. Thanks for the question.

    [font="Verdana"]Please don't go. The drones need you. They look up to you.[/font]
    Connect to me on LinkedIn

  • Koen Verbeeck (8/20/2013)


    Nice question about a pretty unknown product. Thanks.

    Heh! I've seen demo's of DQS, and of all the adjectives one could use to describe it, "pretty" would be pretty much at the bottom of the list. The user interface qualifies among the ugliest I have seen (though even that pales in comparison to the user experience of actually trying to do work with DQS).

    However, I do agree with "unknown". 😉


    Hugo Kornelis, SQL Server/Data Platform MVP (2006-2016)
    Visit my SQL Server blog: https://sqlserverfast.com/blog/
    SQL Server Execution Plan Reference: https://sqlserverfast.com/epr/

  • Richard Warr (8/20/2013)


    I use DQS quite a lot and those steps don't bear much relation to what you do.

    1) Create/Map Knowledge Base

    2) Create DQ Project

    3) Run project to cleanse data

    is more like it.

    There is a "Configuration" option but it's not always necessary.

    Nice to see another of the features introduced in SQLS 2012 making an appearance in QOTD.

    I suspect that the question's first two steps are your first step, while the question's third step is your second and third; but I'm not at all sure, as I've done very little reading on the topic and I've never used this feature. I got it right because I had a vague recollection (quite probably incorrect) that there was something about first configuring the source of valid data, then creating a domain and populating it with that source, and then using the result to do the cleansing. The documentation for DQS at the conceptual level is (as it so often is for MS stuff) pretty abysmal, but probably the lower level documentation is rather better (or nobody would be able to use the feature). If the source is a provider that you subscribe to and have configured before, configuration is irrelevant because it's already been done, so the questions first step doesn't happen, and you go straight to creating a domain and mapping the data source to it; if you are providing the reference data by hand, there isn't any configuration to do as far as I understand it. So the apparent difference between the qotd and your experience is the real difference between two different sets of circumstances in which someone uses DQS.

    At least that's how I understand it - I could easily be completely wrong.

    edit: I've now seen Hugo's comment. The awfulness he describes may be one reason why the concept-level documentation is so utterly awful. I suppose I'll suffer it one day, but I shall be optimistic and assume I don't need to play with it until it's proven that I do.

    Tom

  • I got my choices backwards, oh well. Thanks for the question around a newer feature.

  • I tried going through some of the docs but couldn't get it. Can someone brief me about what it does ??? Or any link providing the DQS functionality in it's simplest form will be appreciated.

  • sqlnaive (8/20/2013)


    I tried going through some of the docs but couldn't get it. Can someone brief me about what it does ??? Or any link providing the DQS functionality in it's simplest form will be appreciated.

    You might try this blog:

    http://www.bidn.com/blogs/cprice1979/ssas/2482/getting-started-with-data-quality-services-dqs-2012

Viewing 15 posts - 1 through 15 (of 19 total)

You must be logged in to reply to this topic. Login to reply