Is this a problem for you because the files are passing in on the fly so you have no way of knowing in advance the data types required? I must...

Thanks for the link (didn't work but I think I found the equivalent article in my own BOL.

I AM already setting up logging on the package. But I am not...

My tests are really showing me that changing these settings does nothing to improve a straight forward data flow of 30 million records (3gb of data) on my server. Setting...

How often does it run? Just thinking if you open the list and it say Idle, then you click on the history it has kicked off....

I guess you would have...

Why am I struggling to get my head around this! ARGH

EDIT: Almost turning this topic into my own blog answering my only questions! ha.

So the Rows per batch is just...

Provide more info regarding the production server. Is it a SQL server with SSIS installed? Is it just this one server, or are you looking to deploy to multiple servers?

I am stuck trying to get my head around this. I want to understand it rather than just try various settings until 1 lot is quicker.

So far I have tried...

No errors in the Agent logs?

What user credentials did you use when running dtexec?

If/when it goes again, until you can find time for the out of hours reboot you could...

I'm tempted to think that the SQL Agent service account you are running the job under is lacking the permissions to both the file system location of the SSIS, or...

Check the service account SQL Agent runs under has the relevant permissions (and compare it to the agent service account on the server that works)

Furthermore - The 8 hours seems wrong. It was around an hour and a half (I still want to speed this up though and get around the errors).

The 6...

As pointless as it sounds, if you add in a normal T-SQL step before the SSIS step and then run the package, does it run the first step ok? or...

In answer to some of my own question - When the memory is not available it is supposed to use the specified directory. I have changed this from the system...

I've got a horrible feeling for you that the new user will not allow access. Otherwise the new postroom worker Chris Smith would be able to access the sensitive data...

Have you tried storing the packages on the server/Pointing the SQL Job to the file system (whichever of the 2 you haven't tried).

Also, if you stick logging on for the...