Hello,
I have a design question. In our project we are giving the users of our website the ability to upload csv files to our database. The problem that we are facing now is how to mitigate the concurrency issue since all the csv files are populated in the same table for all the users.
Basically when the user uploads the file to our server we have a job that picks up and puts it into a staging table, from there there is another job that applies the business logic and populates the main table which is the source of reports.
In this scenario if multiple users (could be thousands) want to upload files at or around the same time how should we design the solution to have minimum concurrency issues.
Your help is greatly appreciated.
thanks,
Moe M
Database Consultant
http://www.cubeangle.com