Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase

Get Notification when a new column added to flat file Expand / Collapse
Author
Message
Posted Thursday, June 13, 2013 12:45 PM
Forum Newbie

Forum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum Newbie

Group: General Forum Members
Last Login: Monday, July 28, 2014 12:35 PM
Points: 7, Visits: 246
I am working on sql server 2005. We have some SSIS packages which loads data from multiple flat files. Flat files comes from other group. Sometimes they just add a new column to the file(remove a column also) and process without letting us know. I just wonder is there any script which catch the changes at source end wheteher its a flat file or a sql table and let us know the change. Appriciate any feedback.

Post #1463259
Posted Thursday, June 13, 2013 1:02 PM


SSC-Enthusiastic

SSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-EnthusiasticSSC-Enthusiastic

Group: General Forum Members
Last Login: Yesterday @ 10:40 AM
Points: 141, Visits: 601
I'm assuming that the file fails when this happens? In which case you can set up an error handler to inform you that it failed? Or am I missing something?
Post #1463270
Posted Thursday, June 13, 2013 1:10 PM
Hall of Fame

Hall of FameHall of FameHall of FameHall of FameHall of FameHall of FameHall of FameHall of FameHall of Fame

Group: General Forum Members
Last Login: Yesterday @ 1:55 PM
Points: 3,991, Visits: 3,011
That would be the simple and very effective way to handle it. I have some flatfiles that are loaded daily and processed through a stored procedure using BULK INSERT. Since the database job calls the procedure, the job notifies us when it fails for any reason. The usual reason is that the creator of the file decided it would be a good idea to add a column without telling anyone, so we see what happened and then tell them to fix their file and resubmit it. Any changes they want to make to the file format we previously agreed to have to go through a process.


Tally Tables - Performance Personified
String Splitting with True Performance
Best practices on how to ask questions
Post #1463274
Posted Thursday, June 20, 2013 7:19 AM
Forum Newbie

Forum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum Newbie

Group: General Forum Members
Last Login: Monday, July 28, 2014 12:35 PM
Points: 7, Visits: 246
Sorry for late response. Thanks a lot Mathew and Ed for your reply. Right now we set up email notification when SSIS package fails. When it fails, we jump into it and solve the problems. This works fine. What I wanted to set up is, a sort of script task/ any task which will compare the current flat file format with updated flat file format from other group and gives us the changes notification.
Post #1465682
« Prev Topic | Next Topic »

Add to briefcase

Permissions Expand / Collapse