Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase

Speed up simple SSIS load Expand / Collapse
Author
Message
Posted Monday, January 28, 2013 6:14 AM
SSC Rookie

SSC RookieSSC RookieSSC RookieSSC RookieSSC RookieSSC RookieSSC RookieSSC Rookie

Group: General Forum Members
Last Login: Monday, November 4, 2013 12:17 PM
Points: 40, Visits: 134
Hi

I just published a new post on SQL Server Central

SSIS 6 Million rows in 60 seconds using standard laptop and I was wondering if there are any other ways to speed it up?

I want to use one physical disk and source as text file (later on I will try additional USB drives and convert source to RAW File)

Here is my set up:
Recovery Model: Simple
Initial DB Size: 1000MB (above what I need)
Connections: Flat File (fast parse property had little effect) + OLE DB (I tried SQL Server Destination but had minor improvement)
Buffers: Tried various settings but it seems in this case it doesn't have much affect.

Is there anything else I can try?
Man thanks
Emil
Post #1412388
Posted Monday, January 28, 2013 8:26 AM
SSC Rookie

SSC RookieSSC RookieSSC RookieSSC RookieSSC RookieSSC RookieSSC RookieSSC Rookie

Group: General Forum Members
Last Login: Monday, November 4, 2013 12:17 PM
Points: 40, Visits: 134
Just an update... I changed Package Size to 32k and Commit size 0 and load completes within 43s. (from 100k rows per sec to 139k per sec)

Regards
Emil
Post #1412463
« Prev Topic | Next Topic »

Add to briefcase

Permissions Expand / Collapse