Is the load time spread evenly across all of the processes, or is there one particular bottleneck?

Nice, detailed post, well done. You've clearly done your homework on this one.

Regarding the incremental load, have you considered using a pattern like this?

- Query target table for MaxDate =...

regrahc (1/10/2016)

---

Hello,

SQL Newbie here - need to move data to another table after it's 30 days old - not getting an error message, but it isn't moving data that I...

Sl33py (1/9/2016)

---

Sorry All, Different Timezone here in SA.

We pull ALL the data for our daily summary tables over every day for a full financial year from Micros, this goes...

Steve Jones - SSC Editor (1/8/2016)

---

BTW, apparently the quality of my writing has also gone down. Got this lovely note today

Your article today compels me to seek your “Unsubscribe”...

Luis Cazares (1/8/2016)

---

Phil Parkin (1/8/2016)

---

Luis Cazares (1/8/2016)

---

You...

Luis Cazares (1/8/2016)

---

You mean like Phil Parkin,...

Sl33py seems to have dozed off 😀

Sl33py (1/8/2016)

---

Hi All

I have a SSIS dataflow task that pulls data from my staging table, this table for example has 315000 rows.

I run the job which is a basic select...

scottcabral (1/8/2016)

---

Hi,

I have a process that will import a txt file each month. There will be 2 separate txt files. One is a monthly file that will be delivered to...

You may want to point the developer here.

A script task would be used to call this.

The script task would need to assign the returned path to an SSIS variable, which...

But you shouldn't. Unless...

joeshu26 (1/8/2016)

---

Is there a script that brings up a prompt that allows user to navigate/select path of flat file connection string and assign it variable to be used in Data...

dramon14 (1/8/2016)

---

Yes sir, that's my intention, to create fully dynamic process for reading files and perform the Load to be content with the corresponding tables in the database.

I thought the...

d.carpenter (1/8/2016)

---

I will be installing a new SQL Server 2014 database system, which is based on our current SQL Server 2005 database system.

The new system will be on a completely...