Random Data is inserted in SSIS

  • Hi

    I m using SSIS to transform the data from csv file(which has fixed width as delimiter) to database. I m inserting 10K records from csv file to database table. My problem is that data is inserted successfully but in improper order. Some times, it is missing sequence order. For example, data from 1 to 520 records are inserted sequentially into the database table and then it is inserting 6000-10000 records and thereafter it is continuing to insert from 521-5999 records. I checked the csv file, data is in order(1-10000). Can you please tell me the reason why it is happen?

  • Database tables do not have an order. What is the problem, exactly?

    If you haven't even tried to resolve your issue, please don't expect the hard-working volunteers here to waste their time providing links to answers which you could easily have found yourself.

  • Data is not inserting in order from csv to database table. csv file has 10K records which has unique id records(1,2,3,....10000). when I transform the csv file data to database table then it is inserting in the following format(1,2,3,....520,6000,6001,.....10000,521,522,....5999)

  • gajayku (7/9/2014)


    Data is not inserting in order from csv to database table. csv file has 10K records which has unique id records(1,2,3,....10000). when I transform the csv file data to database table then it is inserting in the following format(1,2,3,....520,6000,6001,.....10000,521,522,....5999)

    As long as the 'UniqueId' in the CSV maps to the 'UniqueId' in the table, order does not matter.

    If you haven't even tried to resolve your issue, please don't expect the hard-working volunteers here to waste their time providing links to answers which you could easily have found yourself.

  • Hi

    I m attaching the files of input csv file and the data inserted in the database table. The delimiter is fixed length of 88.

  • Hi

    My unique Id is of type string. Is that is the problem for random data insertion??

  • I really don't understand the issue here.

    Perhaps someone else in the forum can help you.

    If you have source and target columns whose data types do not match, you may need to use a data transformation component to fix that.

    If you haven't even tried to resolve your issue, please don't expect the hard-working volunteers here to waste their time providing links to answers which you could easily have found yourself.

  • gajayku (7/9/2014)


    Hi

    My unique Id is of type string. Is that is the problem for random data insertion??

    I think you used a SELECT statement to verify the results?

    Tables in a relational model do not have any order.

    I repeat: do not have any order.

    If you want an order, use ORDER BY in your query.

    The database does not care if the unique ID jumps from 520 to 6000.

    It is even possible the actual storage of the data is in another order. Who knows? The order of rows retrieved depends on so many things, such as indexes and query plan.

    Need an answer? No, you need a question
    My blog at https://sqlkover.com.
    MCSE Business Intelligence - Microsoft Data Platform MVP

Viewing 8 posts - 1 through 7 (of 7 total)

You must be logged in to reply to this topic. Login to reply