Inheriting code is always enlightening 🙂

For the issue with the expression on the connection string, there's no real value in having it set up that way if the...

You could do so with a script task, but generic processes such as this can be hard to debug. Alternatively, there are third-party tools that allow you to build dynamic...

Sounds like a good opportunity to use Biml: https://www.timmitchell.net/post/2017/07/12/staging-load-with-biml/

You can look at [catalog].[execution_component_phases] for the logging information on individual data flow components. However, unless you're using Performance or Verbose logging mode, you won't see anything in this table....

Mattie,

The reason it works locally but fails when deployed to the catalog is most likely a result of the PackageProtectionLevel setting.

By default, the package will...

Mattie,

Using a proxy requires a Windows account - you can't use a SQL login for this. However, you can configure the connection manager inside the SSIS package to...

I wrote a blog post a while back on working with SFTP through SSIS: https://www.timmitchell.net/post/2015/08/03/accessing-sftp-with-ssis/

Is it possible to break up this process into batches? You could configure it to run just a batch at a time if you want to control how much data...

SSIS does not have gender analysis, but Melissa Data makes data quality and cleansing tools for SSIS that can do this.

I blogged about something similar a few years ago. Might this help? https://www.timmitchell.net/post/2015/03/23/fix-inconsistent-line-terminators-in-ssis/

Just to be clear, are you trying to control the number of rows loaded when the data flow task executes?If you put the data flow task inside a...

It is possible that SSIS was allowed too little memory. SSIS package executions allocate their own memory outside of what is provisioned for the database engine, and the max server...

Hi Steve,

Thanks for the kind words!

It makes sense to use change tracking for what you describe, in capturing incremental changes for frequencies less than a day....

If you must process the change tracking results in order by version ID, you would have to use a row-by-row solution such as the OLE DB Command or a while...

Thanks for the kind words! Glad to help.