Home Forums SQL Server 2005 SQL Server 2005 General Discussion Inserting a 800 million records from Staging database to EDW, how to totally disable logging RE: Inserting a 800 million records from Staging database to EDW, how to totally disable logging

  • Hi Grant

    Thanks for the reply. I think that you hit the sanil on the head with this 1. I knew if I just explain it, someone will have someone will find what I'm missing actually.

    I'm actually using SSIS to populate from a flat file to the staging, and going from staging to EDW is also SSIS, with a SQL statement file to do the load into the EDW.

    I'll rather then slit up the SQL statement file into smaller pieces or SSIS components, and use the SSIS data flow's OLE Component to control my Rows per batch and Max insert commit size.

    that will sort out all of my problems with the added bonus that I can actually see how many records have been inserted (on Data Flow Path).

    I was feeling a bit uneasy about the SQL statement file in the SSIS, and now I know why.

    And thanks for the other options and suggestions as well.

    Regards

    Chris