Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase

need to upload file daily cumulative Expand / Collapse
Author
Message
Posted Monday, February 25, 2013 5:44 AM


SSC Veteran

SSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC Veteran

Group: General Forum Members
Last Login: Wednesday, April 23, 2014 7:31 AM
Points: 206, Visits: 449
I've been tasked in creating an ssis solution which extracts data once a day, loads specific fields and exports them to a .txt file (pipe delimited), As the final step, it uploads the file via FTP to a source. I've accomplished all these steps successfully, however, I was just asked if the file uploaded could be cumulative since it's uploaded daily,and this is where I'm drawing a blank to fullfill this request. I'm not sure what I need to do additionally to finalize this solution with the cumulative uploads. Any light shed will be appreciated, as always.

Thanks,

John E
Post #1423571
Posted Monday, February 25, 2013 5:58 AM


SSCarpal Tunnel

SSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal Tunnel

Group: General Forum Members
Last Login: Today @ 11:29 AM
Points: 4,986, Visits: 11,685
latingntlman (2/25/2013)
I've been tasked in creating an ssis solution which extracts data once a day, loads specific fields and exports them to a .txt file (pipe delimited), As the final step, it uploads the file via FTP to a source. I've accomplished all these steps successfully, however, I was just asked if the file uploaded could be cumulative since it's uploaded daily,and this is where I'm drawing a blank to fullfill this request. I'm not sure what I need to do additionally to finalize this solution with the cumulative uploads. Any light shed will be appreciated, as always.

Thanks,

John E


Can you be a bit more specific about what 'cumulative' means in this case?

Is the problem that you are doing a full extract every day and the requirement is for changes only?



Help us to help you. For better, quicker and more-focused answers to your questions, consider following the advice in this link.

When you ask a question (and please do ask a question: "My T-SQL does not work" just doesn't cut it), please provide enough information for us to understand its context.
Post #1423579
Posted Monday, February 25, 2013 6:43 AM


SSC Veteran

SSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC Veteran

Group: General Forum Members
Last Login: Wednesday, April 23, 2014 7:31 AM
Points: 206, Visits: 449
I'm sorry I wasn't more specific. It could be either a cumulative file daily or a file with just new records/leads.

regards,

John
Post #1423591
Posted Monday, February 25, 2013 7:32 AM


SSCarpal Tunnel

SSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal Tunnel

Group: General Forum Members
Last Login: Today @ 11:29 AM
Points: 4,986, Visits: 11,685
OK, I'm not getting any closer to understanding what you want.

Can you provide some sample data showing what you currently have and what you want to have?



Help us to help you. For better, quicker and more-focused answers to your questions, consider following the advice in this link.

When you ask a question (and please do ask a question: "My T-SQL does not work" just doesn't cut it), please provide enough information for us to understand its context.
Post #1423608
Posted Monday, February 25, 2013 8:39 AM


SSC Veteran

SSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC Veteran

Group: General Forum Members
Last Login: Wednesday, April 23, 2014 7:31 AM
Points: 206, Visits: 449
quick update:

At this point I just need to append a date time stamp to the name of the file (i.e. FileName_YYYYMMdd_HHmmss.txt)

How can I accomplish this?

Regards,

John
Post #1423640
Posted Monday, February 25, 2013 8:56 AM
SSC-Addicted

SSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-Addicted

Group: General Forum Members
Last Login: Friday, July 25, 2014 8:32 AM
Points: 488, Visits: 1,859
latingntlman (2/25/2013)
quick update:

At this point I just need to append a date time stamp to the name of the file (i.e. FileName_YYYYMMdd_HHmmss.txt)

How can I accomplish this?



1. Set a string variable with an expression for the file name. The following is close but the date is not formatted to your specifications and will need a bit more work.
"FileName_" + (DT_WSTR, 50) (DT_DBTIMESTAMP)GetDate()
2. Set the connection string expression to the variable in the connection manager for the text file. Be sure the path to the file is included.
Post #1423644
Posted Wednesday, February 27, 2013 9:10 AM


SSC Veteran

SSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC VeteranSSC Veteran

Group: General Forum Members
Last Login: Wednesday, April 23, 2014 7:31 AM
Points: 206, Visits: 449
Done, but I obviously had to modify the expression but it works. Now, I need to send an email upon successful FTP task with the record count from the .TXT file, but I'm not sure if I need to do this thru a data flow task or control flow task. How do I best accomplish this?

Thx,

John
Post #1424595
Posted Wednesday, February 27, 2013 9:19 AM
SSC-Addicted

SSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-AddictedSSC-Addicted

Group: General Forum Members
Last Login: Friday, July 25, 2014 8:32 AM
Points: 488, Visits: 1,859
latingntlman (2/27/2013)
Now, I need to send an email upon successful FTP task with the record count from the .TXT file, but I'm not sure if I need to do this thru a data flow task or control flow task. How do I best accomplish this?


Check out the 'Row Count' Transformation in BOL or MSDN. Here's the article from MSDN.
Post #1424597
« Prev Topic | Next Topic »

Add to briefcase

Permissions Expand / Collapse