Click here to monitor SSC
SQLServerCentral is supported by Redgate
Log in  ::  Register  ::  Not logged in
Home       Members    Calendar    Who's On

Add to briefcase

Mitigating concurrency issues when uploading files Expand / Collapse
Posted Thursday, June 13, 2013 6:49 AM
SSC Rookie

SSC RookieSSC RookieSSC RookieSSC RookieSSC RookieSSC RookieSSC RookieSSC Rookie

Group: General Forum Members
Last Login: Friday, June 14, 2013 7:41 AM
Points: 30, Visits: 81

I have a design question. In our project we are giving the users of our website the ability to upload csv files to our database. The problem that we are facing now is how to mitigate the concurrency issue since all the csv files are populated in the same table for all the users.

Basically when the user uploads the file to our server we have a job that picks up and puts it into a staging table, from there there is another job that applies the business logic and populates the main table which is the source of reports.

In this scenario if multiple users (could be thousands) want to upload files at or around the same time how should we design the solution to have minimum concurrency issues.

Your help is greatly appreciated.


Moe M
Database Consultant
Post #1463053
« Prev Topic | Next Topic »

Add to briefcase

Permissions Expand / Collapse