June 13, 2013 at 12:45 pm
I am working on sql server 2005. We have some SSIS packages which loads data from multiple flat files. Flat files comes from other group. Sometimes they just add a new column to the file(remove a column also) and process without letting us know. I just wonder is there any script which catch the changes at source end wheteher its a flat file or a sql table and let us know the change. Appriciate any feedback.
June 13, 2013 at 1:02 pm
I'm assuming that the file fails when this happens? In which case you can set up an error handler to inform you that it failed? Or am I missing something?
Follow me on twitter @EvoDBACheck out my blog Natural Selection DBA[/url]
June 13, 2013 at 1:10 pm
That would be the simple and very effective way to handle it. I have some flatfiles that are loaded daily and processed through a stored procedure using BULK INSERT. Since the database job calls the procedure, the job notifies us when it fails for any reason. The usual reason is that the creator of the file decided it would be a good idea to add a column without telling anyone, so we see what happened and then tell them to fix their file and resubmit it. Any changes they want to make to the file format we previously agreed to have to go through a process.
June 20, 2013 at 7:19 am
Sorry for late response. Thanks a lot Mathew and Ed for your reply. Right now we set up email notification when SSIS package fails. When it fails, we jump into it and solve the problems. This works fine. What I wanted to set up is, a sort of script task/ any task which will compare the current flat file format with updated flat file format from other group and gives us the changes notification.
Viewing 4 posts - 1 through 3 (of 3 total)
You must be logged in to reply to this topic. Login to reply