October 8, 2012 at 5:58 am
Hi Firends,
I have a folder containing 30 text files(each file is different in structure)....i have 30 data flow tasks to pull the data from the text files to SQL server. If files exists then the respective data flow taks alone must be executed else no action. how to do this? please gimme your suggestions, friends...I use ssis 2008
Any suggestions would be really appreciated
Thanks,
Charmer
October 8, 2012 at 6:08 am
Are you doing the imports in parallel or in series?
A no-code solution could utilise FOREACH containers - the container just does not execute if the file is not there and no error is thrown.
October 8, 2012 at 6:33 am
Phil Parkin (10/8/2012)
Are you doing the imports in parallel or in series?A no-code solution could utilise FOREACH containers - the container just does not execute if the file is not there and no error is thrown.
Yes Phil, i am doing it in parallel....
So ForEach containers does not help ?
Thanks,
Charmer
October 8, 2012 at 6:55 am
Do you have a list of file names? you could use master.dbo.xp_fileexist to determine if they exist or not
***The first step is always the hardest *******
October 8, 2012 at 7:16 am
Charmer (10/8/2012)
Phil Parkin (10/8/2012)
Are you doing the imports in parallel or in series?A no-code solution could utilise FOREACH containers - the container just does not execute if the file is not there and no error is thrown.
Yes Phil, i am doing it in parallel....
So ForEach containers does not help ?
Not ideal.
But if you put a Foreach container around each dataflow, for the specific file which that dataflow is processing, it should work.
October 8, 2012 at 7:19 am
SGT_squeequal (10/8/2012)
Do you have a list of file names? you could use master.dbo.xp_fileexist to determine if they exist or not
yes, i have the file names...so...?
Thanks,
Charmer
October 8, 2012 at 7:51 am
Phil Parkin (10/8/2012)
Charmer (10/8/2012)
Phil Parkin (10/8/2012)
Are you doing the imports in parallel or in series?A no-code solution could utilise FOREACH containers - the container just does not execute if the file is not there and no error is thrown.
Yes Phil, i am doing it in parallel....
So ForEach containers does not help ?
Not ideal.
But if you put a Foreach container around each dataflow, for the specific file which that dataflow is processing, it should work.
So using seperate container is the only option if we do in parallel? or any other better idea Phil..? could you suggest me..?
Thanks,
Charmer
October 8, 2012 at 3:15 pm
Charmer (10/8/2012)
Phil Parkin (10/8/2012)
Charmer (10/8/2012)
Phil Parkin (10/8/2012)
Are you doing the imports in parallel or in series?A no-code solution could utilise FOREACH containers - the container just does not execute if the file is not there and no error is thrown.
Yes Phil, i am doing it in parallel....
So ForEach containers does not help ?
Not ideal.
But if you put a Foreach container around each dataflow, for the specific file which that dataflow is processing, it should work.
So using seperate container is the only option if we do in parallel? or any other better idea Phil..? could you suggest me..?
Can't think of anything that is possible without a load of dev. and introducing quite a bit of complexity. I might be missing something - anyone else got any ideas?
If you were prepared to run things serially, your package design could be much more elegant - though probably at the expense of performance.
Viewing 8 posts - 1 through 8 (of 8 total)
You must be logged in to reply to this topic. Login to reply
This website stores cookies on your computer.
These cookies are used to improve your website experience and provide more personalized services to you, both on this website and through other media.
To find out more about the cookies we use, see our Privacy Policy