February 12, 2003 at 10:19 am
I've noticed that this property is set to "4" by default. I've also read that it is not recommended to set this number to anything greater than the total number of CPUs on your machine.
My development server has 2 CPUs and I have set this value to 2. My DTS package contains 1 connection, 2 destination text files and 2 transformation tasks which essentially dump 2 separate tables from the database to two separate files.
I did this in order to test whether or not both execute in parallel. When I execute the package, one of the two transformation tasks says "Running (<number of rows it has processed so far>)" while the other task has a status of "Started". Once the task which was "Running" is complete, that's when the other task's status changes to "Running (<num..>)". I've also noticed that "<num..>" starts at 1 when the status changes. This tells me that they are running sequentially and not in parallel.
If I use two separate connections, they run in parallel, but this seems strange. I understand that each transformation would require its own connection to the database, but why do I need two connections defined in the DTS when the one I have has a "Reusable" property set to "-1" (True)?
Aside from that, does anyone think that there is any real performance to be gained by running these in parallel anyway? I have approximately 14 queries to export that I was thinking of running in pairs of 2, in parallel...
Thanks in advance!
Edited by - sonicflux on 02/12/2003 12:45:26 PM
Edited by - sonicflux on 02/12/2003 12:47:14 PM
February 18, 2003 at 1:12 pm
Consider the fact each CPU can process one thread at a pyhsical time division each and yes it can provide extra throughput.
As for connection. A connection can always be reused but if only one connection exists then only one data process can be handled. Just like with a query in QA you opena new child window which opens it's own connection when you want to run more than one query at a time. Thus with each process it must have an availble connection to use for itself to open for the data.
Hope that helps.
Viewing 2 posts - 1 through 2 (of 2 total)
You must be logged in to reply to this topic. Login to reply