Concurrent processing in SSIS

SQLServerCentral is supported by Red Gate Software Ltd.

Popular Topics

Home

Members

Calendar

Who's On

Home » Article Discussions » Article Discussions by Author » Discuss content posted by Elliott Whitlow » Concurrent processing in SSIS – Part 1

13 posts, Page 2 of 2

««1 2

Concurrent processing in SSIS – Part 1

Rate Topic

Display Mode

Topic Options

Author

Message

Daniel Bowlin

Posted Thursday, June 17, 2010 12:59 PM

SSCrazy

Group: General Forum Members
Last Login: Friday, May 17, 2013 11:53 AM
Points: 2,672, Visits: 2,416

Nice article. I am looking forward to the second part.

I am curious can you please explain the difference between concurrent processing and parallel processing in this context? If you are running processes concurrently, aren't you basically running them in parallel?

Thanks,

Post #939193

Elliott Whitlow

Posted Thursday, June 17, 2010 1:23 PM

SSCertifiable

Group: General Forum Members
Last Login: Wednesday, April 24, 2013 12:02 PM
Points: 5,854, Visits: 4,873

dbowlin (6/17/2010)

I am curious can you please explain the difference between concurrent processing and parallel processing in this context? If you are running processes concurrently, aren't you basically running them in parallel?

I would generally say yes they are. But additionally you don't necessarily need to have all the processes do they same thing, in these examples you could have each section do something different with the decider being handled in the "Assign Data to Processes" task. So parallel vs. concurrent is more about semantics than anything else..

CEWII

Post #939207

CozyRoc

Posted Wednesday, August 25, 2010 9:29 PM

Ten Centuries

Group: General Forum Members
Last Login: Today @ 5:30 AM
Points: 1,106, Visits: 2,112

Thank you for the article Elliott!

I think you will find this related information interesting. CozyRoc has recently released a new third-party commercial task called Parallel Loop Task. What this task allows is execution of multiple "Foreach Loop Container" iterations in parallel. The setup is very simple:

1. You point to existing loop container that you want executed in parallel.
2. You select how many concurrent threads you want to use for the loop execution.

In tests, a CPU intensive sequential process when executed in parallel on 4-core machine was executed 3 times faster compared to the sequential.

We believe this new task is very powerful tool that can help you use your computer resources in the most efficient way.

---
SSIS Tasks Components Scripts Services | http://www.cozyroc.com/

Post #975320

« Prev Topic | Next Topic »

13 posts, Page 2 of 2

««1 2

Permissions