Bulk loading 149 Tables

  • Question, I have 35 T-SQL stored procedures that bulk load Oracle Linked Tables to SQL Server 2008 and 115 other stored procedures that used that data and create another 115 tables. Running during the middle of the day it took 5 hours to load 20 gigs worth of data. my question is would it be better to drop the index's on all the tables, load the data then rebuild the indexes? it's the 5 or 6 tables that have 3.4 million that are taking 40-50 mins to load from the linked Oracle tables to SQL Server

    Thank you

    Marty Nahtygal

  • Yes, droping and readding after the data load is faster.

    ---------------------------------------------------
    "Thare are only 10 types of people in the world:
    Those who understand binary, and those who don't."

  • Maybe.

    You can only know for sure by testing it.

    Do you load the data in parallel?

    Need an answer? No, you need a question
    My blog at https://sqlkover.com.
    MCSE Business Intelligence - Microsoft Data Platform MVP

  • I have a stored procedure that reads a table of all the bulk load stored procedures and executes each in the correct order. How do you run Parallel ..

  • martynahty (5/14/2014)


    I have a stored procedure that reads a table of all the bulk load stored procedures and executes each in the correct order. How do you run Parallel ..

    Withing TSQL itself it is difficult to run multiple queries in parallel. Personally I would use an SSIS package to launch multiple stored procedures at the same time.

    Need an answer? No, you need a question
    My blog at https://sqlkover.com.
    MCSE Business Intelligence - Microsoft Data Platform MVP

Viewing 5 posts - 1 through 5 (of 5 total)

You must be logged in to reply to this topic. Login to reply