Data cleansing and Data filtering

  • kommagoni

    SSCommitted

    Points: 1898

    What is data cleansing and Data filtering and how can we do the data cleansing and Data filtering from the SQL 2005 server database to Maximo database.

  • feersum_endjinn

    SSCommitted

    Points: 1964

    ...or to put it more succinctly "how long is a piece of string?"

    🙂

    Sorry I couldn't resist!

    I'm no forum expert but surely you can't expect a decent answer if you post a question like that? Data cleaning/filtering or basically ETL (extract, transform, load) is not a fixed set of procedures or rules. It depends on the data, it depends on the source database (application) and it depends on the destination database (application).

  • rwlp.french

    Old Hand

    Points: 345

    What is data cleansing

    http://en.wikipedia.org/wiki/Data_cleansing

    What is Data filtering

    http://dbconvert.com/filtering.php

    how can we do the data cleansing and Data filtering from the SQL 2005 server database to Maximo database

    Set up connection to SQL 2005 database (simple and easy) see connection mangers in SSIS, and Extract the data. Once processed the data in way you want, lots of tools/processes for that in SSIS, Transforming the data. Then set up connection to Maximo, which l have seen a posting doing using MS Access DB so using possibly an OLEDB conneciton will allow out write the data to the tables in Maximo, Load the data.

    SSIS is an ETL (Extract, Transform, Load) tool.

    How you do these steps depends on the databases, business rules, data etc you are working with. Start playing with SSIS, then google and ask questions

  • brandon_gifford

    Newbie

    Points: 1

    I agree with feersum - really hard to deliver a quick, concise definition. But it's basically removing data duplicates, correcting/removing errors or inconsistencies (even extra spaces), or normalizing all data into 1 format, so someone can easily leverage the data, either in an analytics or data science platform.  I did find some real-world examples of data cleansing: https://www.bisok.com/data-science-workbench/data-cleansing-tools/ Hope this helps!

Viewing 4 posts - 1 through 4 (of 4 total)

You must be logged in to reply to this topic. Login to reply