This wasn't the first time I could have used something like this :) I figure why not share it w/ the rest of my SQLServerCentral.com colleagues! Enjoy :)
The supplied VB.NET code should be implemented in a script task in SSIS. The script will retrieve a distinct list of file names from a table and incorporate them into an ArrayList. It will then compare the ArrayList against a remote FTP server and retrieve only the files that have not already been processed into the database. You must change the parameters to suite your environment in order for the script to work. Please refer to the comments within the script.
