FTP File grab with SSIS

  • Hello, I have a scenario I'm having trouble finding a solution for with SSIS. It's one step of a long process (I have the rest of the process set up fine).

    I need to create an SSIS package that connects to an FTP site and grab the most recent files and move them for processing. Once these files are moved, the rest of the process can take off from there. The FTP has a single filled with files going back for months. The file names have YYYYMMDDHHMMSS included.

    The FTP task seems to want to just open and transfer one file at a time. Putting the FTP task in a ForEach Loop Container seems risky.

    Has anyone done anything like this?

    Thank you! 😀

    Ed Womack
    Get Milked

  • How are you checking for the most Recent files.. Do you store the Latest File Name on every run and use that to determine the next set of files??

  • I hadn't worked out an approach for that yet, but that's one possibility, remember the last current file and then only grab files after that date on the next trip... hmm... this sounds like a scripting task...

    Ed Womack
    Get Milked

  • Do you knw the count of the Files that you are looking to fetch each time? how many times would the job run ?

  • It would run nightly and fetch 2 distinct files with each grab - both would have the most recent date in the file name.

    Ed Womack
    Get Milked

  • I would go with the approach of using a YYYYMMDD* format to get those two files.You can use a for each loop to pass the value using a variable.. Let me know if you it doesn't work for you

Viewing 6 posts - 1 through 6 (of 6 total)

You must be logged in to reply to this topic. Login to reply