Home Forums Data Warehousing Integration Services SSIS Event Handling for Data Flow Tasks with Error Log in SQL Server Table RE: SSIS Event Handling for Data Flow Tasks with Error Log in SQL Server Table

  • kalaiselvan.rajendran (10/4/2013)


    Its Fine. But am Sorting Transformation to get the Unique Values for some Columns.

    And Aggregation Transformation to SUM the Values for Measure Columns.

    Without Using these How Can i Use it thru Memory. Can you elaborate in detail. So that I can correct myself in my Package.

    Getting distinct values and sorting data is something the database engine excels at.

    In SSIS, every row has to be read into memory in order to process these operations.

    This can lead to performance issues with large datasets. If you have enough memory available, it's not a problem, however if you don't have enough memory SSIS will page to disk. When this happens a package can go from a few minutes to a few hours of execution.

    If it is an option, store the data in a staging table and do the sorting and aggregation there.

    Need an answer? No, you need a question
    My blog at https://sqlkover.com.
    MCSE Business Intelligence - Microsoft Data Platform MVP