The reason why it is slow is probably the excessive looping.

SQL Server is optimized to do set-based queries, i.e. all rows at the same time instead of a row at...

This seems more the job for a .NET application.

An example:

File Content and Directory Search using Directory.GetFiles and PLINQ

Great question, had me do some research. First I thought the correct answer was listed as a "funny decoy". Turns out it wasn't... 😀

With the partial cache, the cache size is smaller (and configurable). Every time a row has no match, the lookup needs to go to the database and fetch the row....

The cache is still read into memory, so it won't reduce memory pressure.

A bit odd though you still get the out-of-memory error even after adding an extra 8GB.

There are other...

skaggs.andrew (5/6/2014)

---

This process is going to be used on a nightly basis. Not sure how I could use a raw file unless I had a process that created a...

skaggs.andrew (5/6/2014)

---

Thanks for the response DouglasH. The lookup is the destination table for this workflow. Not really sure how to redesign this mapping to use multiple lookups to...

viresh29 (5/6/2014)

---

Yes,

In 2012 there is new feature called project parameters here you can define parameters on project level and configure your connection manager accordingly.

This feature is really useful...

1) The Run64BitRuntime property is a design time only property. You need to set it to false, since you are developing on a 32-bit environment and you have only the...

Glad you got it solved and thanks for posting back.

Interesting question, thanks.

There are free tools out there... 😉

edit: didn't notice this thread was in the Articles Requested forum.

It might be interesting yes 🙂

What about STUFF? Not sure it works with the text data type.

You can modify the script from this thread to drop only the indexes of a specific table:

http://stackoverflow.com/questions/1344401/how-can-i-drop-all-indexes-in-a-sql-database-with-one-command

Copy and rename a file in SSIS using the File System Task

In the article they use the Copy File method of the File System Task, but you can use Rename...