Log in
::
Register
::
Not logged in
Home
Tags
Articles
Editorials
Stairways
Forums
Scripts
Videos
Blogs
QotD
Books
Ask SSC
SQL Jobs
Training
Authors
About us
Contact us
Newsletters
Write for us
Recent Posts
Recent Posts
Popular Topics
Popular Topics
Home
Search
Members
Calendar
Who's On
Home
»
SQL Server 2005
»
SQL Server 2005 Integration Services
»
No Progress while Update
11 posts, Page 1 of 2
1
2
»»
No Progress while Update
Rate Topic
Display Mode
Topic Options
Author
Message
Charmer
Charmer
Posted Tuesday, September 18, 2012 8:07 AM
Say Hey Kid
Group: General Forum Members
Last Login: Monday, February 18, 2013 2:08 AM
Points: 672,
Visits: 725
Hi Friends,
I am about to update some rows so i use OLEDB command component. When i do this, my updation starts to update for few count of records and does not move further....This is my flow , OLEDB source ---> Look Up1---> LookUp2 ---> OLEDB Command
For example , It starts to fetch 10000 records from Source and goes into OLEDB Command having 4500 records and thats it..remains still......it is not going further and not even showing any error...the data flow remains green for all the time and does not stop .....Why this kinda weird thing is happening? Where do i make mistake?
Please give me suggestions friends....
Thanks,
Charmer
Post #1360810
Koen Verbeeck
Koen Verbeeck
Posted Thursday, September 20, 2012 3:51 AM
SSCrazy Eights
Group: General Forum Members
Last Login: Yesterday @ 2:14 PM
Points: 9,370,
Visits: 6,468
Your mistake is in using the OLE DB Command for doing updates, which is very, very slow.
Try writing the rows to a staging table and do an UPDATE using TSQL in an Execute SQL Task.
How to post forum questions.
Need an answer? No, you need a question.
What’s the deal with Excel & SSIS?
Member of
LinkedIn
. My blog at
LessThanDot
.
MCSA SQL Server 2012 - MCSE Business Intelligence
Post #1361824
Charmer
Charmer
Posted Friday, September 21, 2012 2:37 AM
Say Hey Kid
Group: General Forum Members
Last Login: Monday, February 18, 2013 2:08 AM
Points: 672,
Visits: 725
Koen Verbeeck (9/20/2012)
Your mistake is in using the OLE DB Command for doing updates, which is very, very slow.
Try writing the rows to a staging table and do an UPDATE using TSQL in an Execute SQL Task.
Yes..Koen...If update does not work directly, i create a staging table and pushing the rows into the table and start updating from that table like you said...
but what causes slowing the directly updating?
Koen, May i know what could be the possible ways that i could have done mistakes while using OLEDB command component?
Thanks,
Charmer
Post #1362482
Koen Verbeeck
Koen Verbeeck
Posted Friday, September 21, 2012 2:40 AM
SSCrazy Eights
Group: General Forum Members
Last Login: Yesterday @ 2:14 PM
Points: 9,370,
Visits: 6,468
Could have been anything. Syntax is probably correct, otherwise it would have errored out.
Maybe a deadlock or something?
How to post forum questions.
Need an answer? No, you need a question.
What’s the deal with Excel & SSIS?
Member of
LinkedIn
. My blog at
LessThanDot
.
MCSA SQL Server 2012 - MCSE Business Intelligence
Post #1362483
Charmer
Charmer
Posted Friday, September 21, 2012 6:50 AM
Say Hey Kid
Group: General Forum Members
Last Login: Monday, February 18, 2013 2:08 AM
Points: 672,
Visits: 725
Koen Verbeeck (9/21/2012)
Could have been anything. Syntax is probably correct, otherwise it would have errored out.
Maybe a deadlock or something?
I am the only one who is using this table..i can say this database even...so i believe dead locking is not going to be the reason...but it is having 11 million records to be updated...Koen, is that one of the reason?
Thanks,
Charmer
Post #1362623
Koen Verbeeck
Koen Verbeeck
Posted Friday, September 21, 2012 6:52 AM
SSCrazy Eights
Group: General Forum Members
Last Login: Yesterday @ 2:14 PM
Points: 9,370,
Visits: 6,468
Charmer (9/21/2012)
Koen Verbeeck (9/21/2012)
Could have been anything. Syntax is probably correct, otherwise it would have errored out.
Maybe a deadlock or something?
I am the only one who is using this table..i can say this database even...so i believe dead locking is not going to be the reason...but it is having 11 million records to be updated...Koen, is that one of the reason?
11 million records? Dump the OLE DB command and use a staging table. Unless you like waiting for a few hours for your package to finish.
How to post forum questions.
Need an answer? No, you need a question.
What’s the deal with Excel & SSIS?
Member of
LinkedIn
. My blog at
LessThanDot
.
MCSA SQL Server 2012 - MCSE Business Intelligence
Post #1362625
Charmer
Charmer
Posted Friday, September 21, 2012 9:16 AM
Say Hey Kid
Group: General Forum Members
Last Login: Monday, February 18, 2013 2:08 AM
Points: 672,
Visits: 725
Koen Verbeeck (9/21/2012)
Charmer (9/21/2012)
Koen Verbeeck (9/21/2012)
Could have been anything. Syntax is probably correct, otherwise it would have errored out.
Maybe a deadlock or something?
I am the only one who is using this table..i can say this database even...so i believe dead locking is not going to be the reason...but it is having 11 million records to be updated...Koen, is that one of the reason?
11 million records? Dump the OLE DB command and use a staging table. Unless you like waiting for a few hours for your package to finish.
Even the staging table will be having 10 million records....so Koen, could you tell me how useful it will be? i mean for updating.....
Thanks,
Charmer
Post #1362773
Koen Verbeeck
Koen Verbeeck
Posted Saturday, September 22, 2012 3:26 AM
SSCrazy Eights
Group: General Forum Members
Last Login: Yesterday @ 2:14 PM
Points: 9,370,
Visits: 6,468
Charmer (9/21/2012)
Koen Verbeeck (9/21/2012)
Charmer (9/21/2012)
Koen Verbeeck (9/21/2012)
Could have been anything. Syntax is probably correct, otherwise it would have errored out.
Maybe a deadlock or something?
I am the only one who is using this table..i can say this database even...so i believe dead locking is not going to be the reason...but it is having 11 million records to be updated...Koen, is that one of the reason?
11 million records? Dump the OLE DB command and use a staging table. Unless you like waiting for a few hours for your package to finish.
Even the staging table will be having 10 million records....so Koen, could you tell me how useful it will be? i mean for updating.....
Very useful.
Try updating 11 million rows row by row resulting in 11 million different updates and thus 11 million records in the transaction log, or try updating 11 million records in one single transaction/update.
How to post forum questions.
Need an answer? No, you need a question.
What’s the deal with Excel & SSIS?
Member of
LinkedIn
. My blog at
LessThanDot
.
MCSA SQL Server 2012 - MCSE Business Intelligence
Post #1363085
Charmer
Charmer
Posted Tuesday, September 25, 2012 2:25 AM
Say Hey Kid
Group: General Forum Members
Last Login: Monday, February 18, 2013 2:08 AM
Points: 672,
Visits: 725
Koen Verbeeck (9/22/2012)
Charmer (9/21/2012)
Koen Verbeeck (9/21/2012)
Charmer (9/21/2012)
Koen Verbeeck (9/21/2012)
Could have been anything. Syntax is probably correct, otherwise it would have errored out.
Maybe a deadlock or something?
I am the only one who is using this table..i can say this database even...so i believe dead locking is not going to be the reason...but it is having 11 million records to be updated...Koen, is that one of the reason?
11 million records? Dump the OLE DB command and use a staging table. Unless you like waiting for a few hours for your package to finish.
Even the staging table will be having 10 million records....so Koen, could you tell me how useful it will be? i mean for updating.....
Very useful.
Try updating 11 million rows row by row resulting in 11 million different updates and thus 11 million records in the transaction log, or try updating 11 million records in one single transaction/update.
As far as i know row by row can be done only by OLEDB comand component. If it is not going well, then what is the other solution, Koen?
What i do here is, pushing all records into Staging table and using a Execute SQL task to update all the rows in single transaction....well, the way i do is good or any other better way? Could you tell me, Koen?
Thanks,
Charmer
Post #1363851
Koen Verbeeck
Koen Verbeeck
Posted Tuesday, September 25, 2012 2:30 AM
SSCrazy Eights
Group: General Forum Members
Last Login: Yesterday @ 2:14 PM
Points: 9,370,
Visits: 6,468
Charmer (9/25/2012)
What i do here is, pushing all records into Staging table and using a Execute SQL task to update all the rows in single transaction....well, the way i do is good or any other better way? Could you tell me, Koen?
This is the way to go.
How to post forum questions.
Need an answer? No, you need a question.
What’s the deal with Excel & SSIS?
Member of
LinkedIn
. My blog at
LessThanDot
.
MCSA SQL Server 2012 - MCSE Business Intelligence
Post #1363852
« Prev Topic
|
Next Topic »
11 posts, Page 1 of 2
1
2
»»
Permissions
You
cannot
post new topics.
You
cannot
post topic replies.
You
cannot
post new polls.
You
cannot
post replies to polls.
You
cannot
edit your own topics.
You
cannot
delete your own topics.
You
cannot
edit other topics.
You
cannot
delete other topics.
You
cannot
edit your own posts.
You
cannot
edit other posts.
You
cannot
delete your own posts.
You
cannot
delete other posts.
You
cannot
post events.
You
cannot
edit your own events.
You
cannot
edit other events.
You
cannot
delete your own events.
You
cannot
delete other events.
You
cannot
send private messages.
You
cannot
send emails.
You
may
read topics.
You
cannot
rate topics.
You
cannot
vote within polls.
You
cannot
upload attachments.
You
may
download attachments.
You
cannot
post HTML code.
You
cannot
edit HTML code.
You
cannot
post IFCode.
You
cannot
post JavaScript.
You
cannot
post EmotIcons.
You
cannot
post or upload images.
Copyright © 2002-2013 Simple Talk Publishing. All Rights Reserved.
Privacy Policy.
Terms of Use.
Report Abuse.