May 11, 2012 at 7:14 am
Hi,
ssis noob here 🙂 But willing to learn.
I have visual studio 2008 if this matters.
And the question is- how to i download from ftp site few specific files (wildcards can't be used i guess, file names like aaa, aaab, bbb, bbbx). There are 100s of files there..
i could create a csv file storing those filenames i need to download. What next ?
Or a better way to start ?
May 11, 2012 at 9:07 am
FTP can be scripted - in ssis you could call a batch file which contains your FTP commands
try googling FTP scripting
MVDBA
May 11, 2012 at 9:26 am
Transfer Multiple Files from or to FTP remote path to local path - SSIS
There are no special teachers of virtue, because virtue is taught by the whole community.
--Plato
May 11, 2012 at 9:56 am
opc.three (5/11/2012)
Transfer Multiple Files from or to FTP remote path to local path - SSIS
Wouldn't your example accomplish to download all the files from the FTP ? I need just few, 8 or so and specific ones.. Their names are not going to change, i might need to add few additional ones at one point but that's it.
The simple solution would be probably create those 8 separate tasks but i'm sure SSIS can do better than this.
One more thing -i'm not a programmer, no such background 🙂
So scripting (i assume script task )is my only option here ? No other way to pass a list of file names to FTP task ?
May 11, 2012 at 10:04 am
marttali (5/11/2012)
opc.three (5/11/2012)
Transfer Multiple Files from or to FTP remote path to local path - SSISWouldn't your example accomplish to download all the files from the FTP ? I need just few, 8 or so and specific ones.. Their names are not going to change, i might need to add few additional ones at one point but that's it.
It depends on the file names you are after relative to the set of files in the directory. If you can specify a wildcard pattern then you can limit the number of FTP tasks in your package.
The simple solution would be probably create those 8 separate tasks but i'm sure SSIS can do better than this.
It can do better. Wildcards is one way. A Script Task is another, but you say you're not a programmer so multiple FTP Tasks may be the way you should go to keep it simple. Note that if you have 8 different FTP Tasks added to your Control Flow but you do not connect them with precedence constraints they will run in parallel which might be a better option for you in the end anyway because it can reduce your overall download time.
No other way to pass a list of file names to FTP task ?
Not that I know of. You could load a RecordSet manually and store it in a Variable, then iterate over that using a Foreach Loop Container, but that's only a stone's throw away from doing everything in a Script Task.
There are no special teachers of virtue, because virtue is taught by the whole community.
--Plato
May 11, 2012 at 10:10 am
Well Thank you for your help, luckily creating this simple script i'm more than capable of 🙂
But still it's rather bizarre FTP task is not capable of doing this out of the box. One would think this rather basic usage and need. Or maybe i expect too much...
May 11, 2012 at 10:17 am
marttali (5/11/2012)
Well Thank you for your help, luckily creating this simple script i'm more than capable of 🙂But still it's rather bizarre FTP task is not capable of doing this out of the box. One would think this rather basic usage and need. Or maybe i expect too much...
You can expect whatever you like 😉 The SSIS FTP Task is a basic FTP client however. It only exposes functionality available within the FTP [protocol] itself. Adding support for lists of files to download would be a custom capability above what FTP offers, left obviously for us to sort out if we need it.
There are no special teachers of virtue, because virtue is taught by the whole community.
--Plato
Viewing 7 posts - 1 through 7 (of 7 total)
You must be logged in to reply to this topic. Login to reply