Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase

Transaction is SSIS Expand / Collapse
Author
Message
Posted Thursday, December 13, 2012 2:40 AM
SSC-Enthusiastic

SSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-Enthusiastic

Group: General Forum Members
Last Login: Wednesday, October 15, 2014 3:41 PM
Points: 121, Visits: 1,400
Hi Friends,

I am trying to implement transaction in SSIS for the first time. We are going to migrate few records from source to destination tables using DFT. We are planning to have multiple threads inside the DFT. So if one of the thread fails, the data migration happened thru other threads too should roll back.

I am putting the DFT in a sequence container and setting the transactionoption to required and setting the trasactionoption property of DFTs inside the seq container to supported.

I am getting an error while executing the package. I have started the DTC using Administrative tools. I am still getting the error "The partner transaction manager has disabled its support for remote/network transactions". I saw in few threads that we have to enable remote access thru Component Services.

I am accessing the DB through VPN.

Please help me in resolving the issue.
Post #1396066
Posted Thursday, December 13, 2012 6:22 AM
Ten Centuries

Ten CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen Centuries

Group: General Forum Members
Last Login: Thursday, July 31, 2014 7:15 PM
Points: 1,129, Visits: 1,163
MuraliKrishnan1980 (12/13/2012)
Hi Friends,

I am trying to implement transaction in SSIS for the first time. We are going to migrate few records from source to destination tables using DFT. We are planning to have multiple threads inside the DFT. So if one of the thread fails, the data migration happened thru other threads too should roll back.

I am putting the DFT in a sequence container and setting the transactionoption to required and setting the trasactionoption property of DFTs inside the seq container to supported.

I am getting an error while executing the package. I have started the DTC using Administrative tools. I am still getting the error "The partner transaction manager has disabled its support for remote/network transactions". I saw in few threads that we have to enable remote access thru Component Services.

I am accessing the DB through VPN.

Please help me in resolving the issue.

I am not completely sure about the issue you are receiving ..
but I hope this link helps..
http://social.msdn.microsoft.com/Forums/en-GB/sqlintegrationservices/thread/ba76283e-add7-4951-a0b1-332b7b6107c2


~ demonfox
___________________________________________________________________
Wondering what I would do next , when I am done with this one
Post #1396153
Posted Saturday, December 15, 2012 9:18 PM


SSC Journeyman

SSC JourneymanSSC JourneymanSSC JourneymanSSC JourneymanSSC JourneymanSSC JourneymanSSC JourneymanSSC Journeyman

Group: General Forum Members
Last Login: Friday, September 19, 2014 1:08 PM
Points: 80, Visits: 351
Hi Guys,

I took a look at the MSDTC article. I have been down that path before during setup.
I guess the question is why use a transaction at all when doing a large ETL jobs.

Here are some ideas that might be quicker overall.


1 - If you can get away with an UPSERT, do it. It is better than trying to roll back a huge load.
It is also restartable. Use a hosptial table to direct errored out rows for research of post processing.


2 - Create a database snapshot before the load. All changed records will go to this sparse file.
When the job errors out, stop the ETL. Use a database restore to put the data back to a steady state.


I ended up rewriting a database warehousing project recently. Plan 1 worked our very well since I did a singe pass of 10 M rows and then did several passes against the hospital table to fix data integrity issues.

In summary, always question why you are going down a path before you start.

Good luck



John Miner
Crafty DBA
www.craftydba.com
Post #1396964
« Prev Topic | Next Topic »

Add to briefcase

Permissions Expand / Collapse