Post reply

SSIS with Flat File Source limitations

  • December 18, 2013 at 6:54 am

    #287500

    Hi,

    Can you please let me know the Limitaions for Importing CSV file Data into DB.

    Volume like Max File Size? and No of Records?

    I saw an article in MSDN,which inserted 1TB in 30 minutes....

    But for me it is as normal what we do regularly...

    Thanks,

    SP

  • December 18, 2013 at 7:02 am

    #1674411

    it depends on how you design your package; you need to avoid any RBAR processing within the package itself.

    http://www.sqlservercentral.com/Forums/Topic362049-148-1.aspx#bm1174434

    http://www.sqlservercentral.com/Forums/Topic362049-148-1.aspx#bm1174434

    The SSIS is using streaming approach (processing blocks of data) and can process unlimited amounts of data, if the SSIS package is designed properly.

    So the correct answer is you can process unlimited amounts of flat file data. However you have to be careful what kind of partially blocking asynchronous transformations you use in your data flow.

    Lowell

    --help us help you! If you post a question, make sure you include a CREATE TABLE... statement and INSERT INTO... statement into that table to give the volunteers here representative data. with your description of the problem, we can provide a tested, verifiable solution to your question! asking the question the right way gets you a tested answer the fastest way possible!

Viewing 2 posts - 1 through 1 (of 1 total)

You must be logged in to reply to this topic. Login to reply