SQL Clone
SQLServerCentral is supported by Redgate
 
Log in  ::  Register  ::  Not logged in
 
 
 


Get Notification when a new column added to flat file


Get Notification when a new column added to flat file

Author
Message
Make an Impact
Make an Impact
Valued Member
Valued Member (51 reputation)Valued Member (51 reputation)Valued Member (51 reputation)Valued Member (51 reputation)Valued Member (51 reputation)Valued Member (51 reputation)Valued Member (51 reputation)Valued Member (51 reputation)

Group: General Forum Members
Points: 51 Visits: 363
I am working on sql server 2005. We have some SSIS packages which loads data from multiple flat files. Flat files comes from other group. Sometimes they just add a new column to the file(remove a column also) and process without letting us know. I just wonder is there any script which catch the changes at source end wheteher its a flat file or a sql table and let us know the change. Appriciate any feedback.
Matthew Darwin
Matthew Darwin
SSC-Addicted
SSC-Addicted (459 reputation)SSC-Addicted (459 reputation)SSC-Addicted (459 reputation)SSC-Addicted (459 reputation)SSC-Addicted (459 reputation)SSC-Addicted (459 reputation)SSC-Addicted (459 reputation)SSC-Addicted (459 reputation)

Group: General Forum Members
Points: 459 Visits: 875
I'm assuming that the file fails when this happens? In which case you can set up an error handler to inform you that it failed? Or am I missing something?

Follow me on twitter @EvoDBA

Check out my blog Natural Selection DBA
Ed Wagner
Ed Wagner
SSCoach
SSCoach (16K reputation)SSCoach (16K reputation)SSCoach (16K reputation)SSCoach (16K reputation)SSCoach (16K reputation)SSCoach (16K reputation)SSCoach (16K reputation)SSCoach (16K reputation)

Group: General Forum Members
Points: 16583 Visits: 10063
That would be the simple and very effective way to handle it. I have some flatfiles that are loaded daily and processed through a stored procedure using BULK INSERT. Since the database job calls the procedure, the job notifies us when it fails for any reason. The usual reason is that the creator of the file decided it would be a good idea to add a column without telling anyone, so we see what happened and then tell them to fix their file and resubmit it. Any changes they want to make to the file format we previously agreed to have to go through a process.


Tally Tables - Performance Personified
String Splitting with True Performance
Best practices on how to ask questions
Make an Impact
Make an Impact
Valued Member
Valued Member (51 reputation)Valued Member (51 reputation)Valued Member (51 reputation)Valued Member (51 reputation)Valued Member (51 reputation)Valued Member (51 reputation)Valued Member (51 reputation)Valued Member (51 reputation)

Group: General Forum Members
Points: 51 Visits: 363
Sorry for late response. Thanks a lot Mathew and Ed for your reply. Right now we set up email notification when SSIS package fails. When it fails, we jump into it and solve the problems. This works fine. What I wanted to set up is, a sort of script task/ any task which will compare the current flat file format with updated flat file format from other group and gives us the changes notification.
Go


Permissions

You can't post new topics.
You can't post topic replies.
You can't post new polls.
You can't post replies to polls.
You can't edit your own topics.
You can't delete your own topics.
You can't edit other topics.
You can't delete other topics.
You can't edit your own posts.
You can't edit other posts.
You can't delete your own posts.
You can't delete other posts.
You can't post events.
You can't edit your own events.
You can't edit other events.
You can't delete your own events.
You can't delete other events.
You can't send private messages.
You can't send emails.
You can read topics.
You can't vote in polls.
You can't upload attachments.
You can download attachments.
You can't post HTML code.
You can't edit HTML code.
You can't post IFCode.
You can't post JavaScript.
You can post emoticons.
You can't post or upload images.

Select a forum

































































































































































SQLServerCentral


Search