July 8, 2022 at 11:38 am
I'm planning a solution where I have a upload to Container triggered a pipeline which copies these files to SQL tables, and then deletes the files. I would prefer to have this pipeline run from a event trigger, since in case the data is not in place for whatever reason I can still accomodate late data. My worry is that, I'm expecting around 10 files in my container (all will be uploaded somewhat simultaneously) and I want to wait for all these files before running my pipeline. If I have a pipeline that has a file uploaded trigger and it gets uploaded 10 files "at once", will it run 10 times?
July 8, 2022 at 1:21 pm
The trigger will be fired 10 times as there are 10 'blob created' events.
How do you know when the set of files is ready? Is there a particular file name for the last file?
You'll need some logic that checks the number of files in the folder or the file names or something and then only continues if you have the complete set
Viewing 2 posts - 1 through 2 (of 2 total)
You must be logged in to reply to this topic. Login to reply
This website stores cookies on your computer.
These cookies are used to improve your website experience and provide more personalized services to you, both on this website and through other media.
To find out more about the cookies we use, see our Privacy Policy