Nice. I figured there was something else up your sleeve otherwise you would not have said anything. That could be handy for some as it relates to their ability to...

I could be wrong because I do not do much of this type of programming but I think xp_dirtree will only get you the list of directories however not the...

My understanding is the file names, while showing similar patterns, change from day to day.

SSIS OLE DB Destinations are using the same API that BULK INSERT would. The only difference here is that SSIS can access the file system natively whereas xp_cmdshell would have...

I re-read the original post this morning and realized I had misread an important requirement so I removed my last post which was way off the mark.

I do not think...

Do the 30 scripts deliver the exact same shaped resultsets, e.g. exact same number and type of columns, or are there some variations from one to the other?

Do you want...

Is this SQL Server code? || is not a valid logical operator in T-SQL. Why do you want SQL Server to evaluate a passed in logic statement in this way?...

Look in msdb for tables dbo.sysjobs, dbo.sysjobschedules and dbo.sysschedules. Those three have what you need.

If you're moving to a different structure then I would not trust anything to validate that anyhow. Chances are you will need custom methods to validate your custom transformations. Common...

I meant so that a job is not killed midstream by the service stopping. Also keep missed schedules in mind while the service is down.

- removed -

log shipping will be fine. clustering and mirroring need more attention due to failover scenarios. also check for running Agent jobs.

I recommended in SQL Server to begin with the idea...

It could be old news too. Have you recycled your server since you added the index?

My guess is that the pulling of the data from SQL Server is not the bottleneck in this scenario it is the inserting of data into Postgres as 5000 rows/second...