Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase

Executing multiple instances of SSIS package in parallel Expand / Collapse
Author
Message
Posted Thursday, July 8, 2010 4:47 PM
SSC-Addicted

SSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-Addicted

Group: General Forum Members
Last Login: Thursday, October 3, 2013 5:13 PM
Points: 400, Visits: 339
What exactly I want to implement is like this -

I have a file watcher which kicks the SSIS packages when ever a flat file arrives into the Source Folder.

When ever the a new file arrives SSIS packages has to process the file by taking the parameters from the configuration file. (Database name, Servername of the Destination table are in Config file)

Meanwhile, another flat file is placed in the source folder and another instance of the same SSIS package needs to be used to process this file.. and so on...

every time the package has to take the parameters from the configuration file.

please help me in solving this issue.

Thanks in advance.


Post #949655
Posted Friday, July 9, 2010 10:42 PM


Valued Member

Valued MemberValued MemberValued MemberValued MemberValued MemberValued MemberValued MemberValued Member

Group: General Forum Members
Last Login: 2 days ago @ 8:47 PM
Points: 73, Visits: 184
First let us know below details.

1. how you are activating/running package means, are u using sql job or commandline command or autosys or esp or maestro etc
2. are ur source filenames same all the time? or differs?
3. ...


Each new run of the package will create a new instance, it will use same config file every time, so you can run multiple instances.

if source file name is same then, move file to a working folder and then run ur package

you can run commandline command each time when you see file in source folder...it works in separate process...

RB
Post #950308
Posted Saturday, July 10, 2010 2:22 PM
SSC-Addicted

SSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-Addicted

Group: General Forum Members
Last Login: Thursday, October 3, 2013 5:13 PM
Points: 400, Visits: 339
PaVeRa22 (7/9/2010)
First let us know below details.

1. how you are activating/running package means, are u using sql job or commandline command or autosys or esp or maestro etc
2. are ur source filenames same all the time? or differs?
3. ...


Each new run of the package will create a new instance, it will use same config file every time, so you can run multiple instances.

if source file name is same then, move file to a working folder and then run ur package

you can run commandline command each time when you see file in source folder...it works in separate process...

RB


1. I am running the SSIS package using SQL agent job. (but I want to run many jobs at the same time which calls the same SSIS package, but the configuration file values should be changed)
2. Every time the source file name is different. (it will have _timestamp)
I want to include flat file name and Destination table name (predefined) using configuration file.
Post #950378
Posted Wednesday, July 14, 2010 10:31 AM


SSCertifiable

SSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiable

Group: General Forum Members
Last Login: Thursday, October 9, 2014 1:02 PM
Points: 6,032, Visits: 5,284
anand_vanam (7/10/2010)
1. I am running the SSIS package using SQL agent job. (but I want to run many jobs at the same time which calls the same SSIS package, but the configuration file values should be changed)
2. Every time the source file name is different. (it will have _timestamp)
I want to include flat file name and Destination table name (predefined) using configuration file.
1. Can't, Agent will run a SINGLE instance of a job at a time.
2. The package needs to be smart enough to pick this out.

You might look at:
http://www.sqlservercentral.com/articles/Integration+Services+(SSIS)/70346/

CEWII
Post #952515
Posted Wednesday, November 7, 2012 2:15 PM


SSC-Enthusiastic

SSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-Enthusiastic

Group: General Forum Members
Last Login: Yesterday @ 2:17 PM
Points: 178, Visits: 634
anand_vanam (7/10/2010)


1. I am running the SSIS package using SQL agent job. (but I want to run many jobs at the same time which calls the same SSIS package, but the configuration file values should be changed)
2. Every time the source file name is different. (it will have _timestamp)
I want to include flat file name and Destination table name (predefined) using configuration file.


1. You can run the exact same package simultaneously. What you can't do is execute a job while it's currently running. I can set up a job to run package anand_vanam.dtsx. I can set up a second job to run the same package, and they'll run simultaneously. So yes you can run many JOBS which calls the same SSIS Package.
2. It looks like you're looking for a way to execute a package with dynamic parameters. There are many ways to do this. This might be a good start: http://www.mssqltips.com/sqlservertip/1775/different-ways-to-execute-a-sql-server-ssis-package/
Post #1382175
« Prev Topic | Next Topic »

Add to briefcase

Permissions Expand / Collapse