Database Administration via CrowdSourcing

Jeffrey Yao, 2015-05-25

According to Wikipedia:

 Crowdsourcing is the process of obtaining needed services, ideas, or content by soliciting contributions from a large group of people, and especially from an online community, rather than from traditional employees or suppliers.

Every DBA must have googled something to address his/her technical issue, and broadly speaking, this can be considered as using crowdsourcing for work purpose. But this is a very light way of crowdsourcing. To me, a real high-quality and serious crowdsourcing for database administration needs to be treated as a real project with planning, timeline, goals, budget and some senior DBA resources. The key to success is on that senior DBA who should be able to design a needed system and divide it into small logical units that are suitable for crowdsourcing.

Some advantages for crowdsourcing in database administration can be:

1. Scalability in database administration capacity: we can harvest the wisdom of the online community to increase our productivity and efficiency instead of relying on more man-hours to meet increased business requirements.

2. Cost control: DBA work is not cheap, yet finding the quality resource is still challenging most of the time. With proper crowdsourcing, we can minimize the cost and reduce the burn-outs of existing DBAs.

3. Work Quality Control: Through paid crowdsourcing channels (such as, we can usually award the task to the best rated bidder for the work. Through non-paid crowdsourcing (like, people will vote for the best answer, and this is like a quality control feature free to everyone.

4.  Potential big time saving: In database administration, there are quite some very impressive open-sourced tools, which, if used properly, may save us huge amount of time. To develop these free tools alone may easily cost an excellent senior DBA hundreds (if not thousands) of hours.

Currently, crowdsourcing does not attract much attentions from IT leaders. I think it is mostly because of a few hurdles listed below:

1. Lack of crowdsourcing management professionals: crowdsourcing itself is mainly rooted in online community, but we have vast number of channels for crowdsourcing opportunities, such as twitter, linkedin, stackoverflow, experts’ personal blogs, and various online forums under specific websites (in sql server domain, we have MS forums, and SSC forums etc), and also those professional conferences (such as PASS annual conference) can be a good channel as well. To manage crowdsourcing channels, we need people to know what to ask and how to ask in each different channel and can engage in constructive conversations with online community, and at the end, the senior DBA resource should be able to assemble everything together to make the whole solution work. This is no easy work.

2. Hard to trace responsibility: if  I start a crowdsourcing project and it fails, who should take the responsibility? The online community or myself? But on the other hand, if I am assigned a specific project, if the project fails, it is my sole responsibility, thus easy for management to manage.

Crowdsourcing administration does not necessarily mean easy or inexpensive especially for small project, but crowdsourcing can be a good way to amplify the capacities of existing resources, and maximize investment in technical project. Most important, it can reduce the dependency on hiring more qualified staff to start work.

Maybe in future, we will some 3rd party companies dedicated to such crowdsourcing project and then sell the service / solution or product to other companies.





Related content

Database Mirroring FAQ: Can a 2008 SQL instance be used as the witness for a 2005 database mirroring setup?

Question: Can a 2008 SQL instance be used as the witness for a 2005 database mirroring setup? This question was sent to me via email. My reply follows. Can a 2008 SQL instance be used as the witness for a 2005 database mirroring setup? Databases to be mirrored are currently running on 2005 SQL instances but will be upgraded to 2008 SQL in the near future.

Robert Davis


1,567 reads

Networking – Part 4

You may want to read Part 1 , Part 2 , and Part 3 before continuing. This time around I’d like to talk about social networking. We’ll start with social networking. Facebook, MySpace, and Twitter are all good examples of using technology to let…

Andy Warren


1,530 reads

Speaking at Community Events – More Thoughts

Last week I posted Speaking at Community Events – Time to Raise the Bar?, a first cut at talking about to what degree we should require experience for speakers at events like SQLSaturday as well as when it might be appropriate to add additional focus/limitations on the presentations that are accepted. I’ve got a few more thoughts on the topic this week, and I look forward to your comments.

Andy Warren


360 reads