Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase

SSIS with Flat File Source limitations Expand / Collapse
Author
Message
Posted Wednesday, December 18, 2013 6:54 AM


Ten Centuries

Ten CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen Centuries

Group: General Forum Members
Last Login: Today @ 12:20 AM
Points: 1,026, Visits: 634
Hi,


Can you please let me know the Limitaions for Importing CSV file Data into DB.

Volume like Max File Size? and No of Records?

I saw an article in MSDN,which inserted 1TB in 30 minutes....

But for me it is as normal what we do regularly...

Thanks,
SP
Post #1524108
Posted Wednesday, December 18, 2013 7:02 AM


SSChampion

SSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampionSSChampion

Group: General Forum Members
Last Login: Today @ 3:47 AM
Points: 12,738, Visits: 31,041
it depends on how you design your package; you need to avoid any RBAR processing within the package itself.

http://www.sqlservercentral.com/Forums/Topic362049-148-1.aspx#bm1174434

http://www.sqlservercentral.com/Forums/Topic362049-148-1.aspx#bm1174434
The SSIS is using streaming approach (processing blocks of data) and can process unlimited amounts of data, if the SSIS package is designed properly.
So the correct answer is you can process unlimited amounts of flat file data. However you have to be careful what kind of partially blocking asynchronous transformations you use in your data flow.


Lowell

--There is no spoon, and there's no default ORDER BY in sql server either.
Actually, Common Sense is so rare, it should be considered a Superpower. --my son
Post #1524113
« Prev Topic | Next Topic »

Add to briefcase

Permissions Expand / Collapse