SSIS Parallel Processing

  • I have to modify an existing package to enable parallel processing (multi threading) package currently processes flat files and dumps them over I need to enable process where it processes multple flat files at the same time

    what are the different ways to achieve that

  • You could place different data flows in one single sequence container. Each dataflow reads a file and processes it.

    Need an answer? No, you need a question
    My blog at https://sqlkover.com.
    MCSE Business Intelligence - Microsoft Data Platform MVP

  • WangcChiKaBastar (3/16/2010)


    I have to modify an existing package to enable parallel processing (multi threading) package currently processes flat files and dumps them over I need to enable process where it processes multple flat files at the same time

    what are the different ways to achieve that

    If you can use third-party solutions, check the commercial CozyRoc Parallel Loop Task. It can execute standard SSIS loop container concurrently, utilizing all your server processing resources. In tests, a CPU intensive sequential process when executed in parallel on 4-core machine was executed 3 times faster compared to the sequential. Cheers!

    ---
    SSIS Tasks Components Scripts Services | http://www.cozyroc.com/

Viewing 3 posts - 1 through 2 (of 2 total)

You must be logged in to reply to this topic. Login to reply