SQL Clone
SQLServerCentral is supported by Redgate
 
Log in  ::  Register  ::  Not logged in
 
 
 


Speed up simple SSIS load


Speed up simple SSIS load

Author
Message
KatieAndEmil
KatieAndEmil
SSC-Enthusiastic
SSC-Enthusiastic (115 reputation)SSC-Enthusiastic (115 reputation)SSC-Enthusiastic (115 reputation)SSC-Enthusiastic (115 reputation)SSC-Enthusiastic (115 reputation)SSC-Enthusiastic (115 reputation)SSC-Enthusiastic (115 reputation)SSC-Enthusiastic (115 reputation)

Group: General Forum Members
Points: 115 Visits: 135
Hi

I just published a new post on SQL Server Central

SSIS 6 Million rows in 60 seconds using standard laptop and I was wondering if there are any other ways to speed it up?

I want to use one physical disk and source as text file (later on I will try additional USB drives and convert source to RAW File)

Here is my set up:
Recovery Model: Simple
Initial DB Size: 1000MB (above what I need)
Connections: Flat File (fast parse property had little effect) + OLE DB (I tried SQL Server Destination but had minor improvement)
Buffers: Tried various settings but it seems in this case it doesn't have much affect.

Is there anything else I can try?
Man thanks
Emil
KatieAndEmil
KatieAndEmil
SSC-Enthusiastic
SSC-Enthusiastic (115 reputation)SSC-Enthusiastic (115 reputation)SSC-Enthusiastic (115 reputation)SSC-Enthusiastic (115 reputation)SSC-Enthusiastic (115 reputation)SSC-Enthusiastic (115 reputation)SSC-Enthusiastic (115 reputation)SSC-Enthusiastic (115 reputation)

Group: General Forum Members
Points: 115 Visits: 135
Just an update... I changed Package Size to 32k and Commit size 0 and load completes within 43s. (from 100k rows per sec to 139k per sec)

Regards
Emil
Go


Permissions

You can't post new topics.
You can't post topic replies.
You can't post new polls.
You can't post replies to polls.
You can't edit your own topics.
You can't delete your own topics.
You can't edit other topics.
You can't delete other topics.
You can't edit your own posts.
You can't edit other posts.
You can't delete your own posts.
You can't delete other posts.
You can't post events.
You can't edit your own events.
You can't edit other events.
You can't delete your own events.
You can't delete other events.
You can't send private messages.
You can't send emails.
You can read topics.
You can't vote in polls.
You can't upload attachments.
You can download attachments.
You can't post HTML code.
You can't edit HTML code.
You can't post IFCode.
You can't post JavaScript.
You can post emoticons.
You can't post or upload images.

Select a forum

































































































































































SQLServerCentral


Search