I'm trying to improve the the performance of a foreach loop task, that reads around 20.000 pdf files each day and registers them in a log table.
I found the Cozyroc Parallel Task but I'm not able to make it work.
I found a couple of Sample Packages, but one uses an Item Enumerator and the other a ADO Net Enumerator. Both declare a variable called "Iter" twice, one with a package scope and the other with a foreach loop scope. I soppose the name of the variable is not relevant.
This Iter variable is map as the foreach loop iterator. In my case, the file enumerator return to the enumeration variable the file name, in a particular format depending on the selected values (Fully qualify, name and extension, etc.).
It seems like the foreach and parallel loop need a "clean variable" to iterate, and I'm wondering if it´s possible to use these two components to improve the file iteration.
Any comment would be appreciated.