Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase

In SSIS Parallelisum or batch run Expand / Collapse
In SSIS, if I have to load multiple file to sql server, I can do using ForEach loop container(which is sequence process). But If I have 500 files, than in SSIS...
Poll ResultsVotes
In SSIS, if I have to load multiple file to sql server, I can do using ForEach loop container(which is sequence process). But If I have 500 files, than in SSIS how can I implement parallelisum or batch run.
0%
0
Member Votes: 0, Anonymous Votes: 0. You don't have permission to vote within this poll.
Author
Message
Posted Thursday, October 10, 2013 11:05 PM
SSC Journeyman

SSC JourneymanSSC JourneymanSSC JourneymanSSC JourneymanSSC JourneymanSSC JourneymanSSC JourneymanSSC Journeyman

Group: General Forum Members
Last Login: Thursday, April 10, 2014 1:29 PM
Points: 86, Visits: 505
In SSIS, if I have to load multiple file to sql server, I can do using ForEach loop container(which is sequence process). But If I have 500 files, than in SSIS how can I implement parallelisum or batch run.
Post #1503866
Posted Thursday, October 10, 2013 11:59 PM
SSC Veteran

SSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC Veteran

Group: General Forum Members
Last Login: Friday, April 04, 2014 4:41 AM
Points: 222, Visits: 194
Hi,

If you are using for-each then sequential process is unavoidable.
I have 2 solutions for you,
1. If you have several types of files(*.xls,*.txt, *csv) then you may have that much number of Foreach containers and direct them to process a specific type

2. You can 3 or 4 folders say Part1, part2, part3... and tell your 3 different Foreach loops to look at a specific folder. Probably for this its better to separate files based on size into each of those folders.


I'll post other ideas if I could think of any.

Regards,
Suresh
Post #1503873
Posted Friday, October 11, 2013 7:21 AM
SSC Journeyman

SSC JourneymanSSC JourneymanSSC JourneymanSSC JourneymanSSC JourneymanSSC JourneymanSSC JourneymanSSC Journeyman

Group: General Forum Members
Last Login: Thursday, April 10, 2014 1:29 PM
Points: 86, Visits: 505
Thank you sir, it does make sence.
Post #1503998
« Prev Topic | Next Topic »

Add to briefcase

Permissions Expand / Collapse