Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase

Restarting SSIS Package Expand / Collapse
Author
Message
Posted Thursday, December 20, 2007 3:36 PM
Forum Newbie

Forum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum Newbie

Group: General Forum Members
Last Login: Friday, October 11, 2013 8:10 AM
Points: 1, Visits: 35
I hope I am describing the scenario correctly. We have an ETL process that is composed of several stored procs. The ETL process is initiated using a web service (I think that's what it is called). The stored procs and the web service are on separate servers. What we have found is that at times there are network glitches which causes the service to lose contact with the SQL Server and the ETL process. Not knowing the status of the ETL process on the SQL Server, it restarts the process from the beginning. This almost always results in conflicts and the process fails, mostly due to one of the processes deleting tmp tables that the other process needs.

We are considering packaging the ETL process as a SSIS package to employ constraints, checkpoints, etc. The architeture would be the same. The SSIS package would be on one server and the web service on another. Would using SSIS to manage the process resolve the issue of the web service restarting the ETL process before the previous process completed?

Any suggestions would be greatly appreciated.



Michael A. Hardy
Post #435421
Posted Friday, December 21, 2007 12:00 PM


Ten Centuries

Ten CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen Centuries

Group: General Forum Members
Last Login: Tuesday, December 2, 2014 1:41 PM
Points: 1,298, Visits: 1,891
In SSIS you can encapsulate ETL process in transactions.

A good article on transactions:

[url=http://www.sqlservercentral.com/articles/SQL+Server+2005+-+SSIS/transactionsinsqlserver2005integrationservices/1653/][/url]


Alex S
Post #435816
« Prev Topic | Next Topic »

Add to briefcase

Permissions Expand / Collapse