Missing Records with SSIS

  • Hi,

    I am getting an issue frequently. I have a SQL statement which inserts huge data into a table using SSIS package. We are observing that all the records are not being copied to destination table.

    Can any body help on this and provide the solution.

    Ram..

    🙂

  • There's not enough information here to provide a solution. As a wild stab in the dark, are there any error outputs that redirect rows that don't go into the destination table output?

    Some other questions:

    How do you identify that it hasn't inserted some rows?

    Is it always the same rows?

    Is there any other pattern to the rows that don't get inserted?

  • How do you identify that it hasn't inserted some rows?

    ---We are able to insert records using query analyzer. The same query if we run in SSIS It is not copying all the records.

    Is it always the same rows?

    ---No. Even the count is mismatching each time.

    Is there any other pattern to the rows that don't get inserted?

    ---Cannot find answer for this question

    🙂

  • You didn't answer whether you had any error outputs set to redirect rows.

    How long is this extract taking, how many rows are there in total and how many are missing?

    Is data being modified/created/deleted in the source system while you're extracting the data?

    It's pretty unlikely for rows to be 'disappearing' within the data flow, unless it's been setup to redirect in some way.

    The select itself could be producing different rows depending on isolation levels, whether data's being modified during the select etc.

  • We are not using dataflow task. We are using script task and data would be around 50 lacks. Around 30% of the data we are missing

    We are inserting into the table with just select query .

    No error output found.

    🙂

  • Why on earth are you using a script task to do this? The SSIS data flow task is specifically designed for taking data from a source and putting it into a destination.

    Any number of things could be wrong with the code in your script task and I doubt anyone will be that interested in debugging it for you. Use the Import/Export wizard to create a package for you, then see how you should be doing this in a data flow.

Viewing 6 posts - 1 through 6 (of 6 total)

You must be logged in to reply to this topic. Login to reply