SQL Clone
SQLServerCentral is supported by Redgate
Log in  ::  Register  ::  Not logged in

The Power of Hadoop

By Steve Jones,

I wrote about Hadoop years ago, when it was a young project from Yahoo. Over the years the framework has evolved to become very important to a number of companies, important enough for Microsoft to make some substantial investments in Hadoop and SQL Server.

Why use Hadoop? What's the power of this framework? It's designed to work with disparate data sets, with structured and unstructured data, from a variety of sources, and perform complex analysis of this data using clusters of inexpensive hardware. In other words, it scales out very nicely.

There are plenty of large companies using Hadoop, which is why Microsoft made their investment in the technology, but there is an interesting use I ran across from a Utah bank. Their security department is using Hadoop in place of traditional data warehouses on relational platforms to analyze security data and proactively make decisions. That's pretty cool to me, especially since security departments seem to have smaller budgets than their mandate would suggest.

I'm not sure how many places I've worked where Hadoop would be useful, but I suspect that as we have larger data sets, from more sources and the need to analyze the data before we put it in a data warehouse, more and more of us will end up using Hadoop along with our SQL Servers.

Steve Jones

The Voice of the DBA Podcasts

We publish three versions of the podcast each day for you to enjoy.

Everyday Jones

The podcast feeds are available at sqlservercentral.mevio.com. Comments are definitely appreciated and wanted, and you can get feeds from there. Overall RSS Feed: or now on iTunes!

Today's podcast features music by Everyday Jones. No relation, but I stumbled on to them and really like the music. Support this great duo at www.everydayjones.com.

You can also follow Steve Jones on Twitter:

Total article views: 775 | Views in the last 30 days: 1
Related Articles

Good Intro Podcast on Hadoop

Have you heard about Hadoop but don't know much about it? What about "big data?" Would you like an i...


Halo 4 and Hadoop

A case study shows how the combination of Azure and Hadoop helped the Halo 4 team grow their success...


Getting ready for Hadoop

Before adopting Hadoop into your organisation there are a number of factors to consider. This artic...


Hadoop and Microsoft

In my Introduction to Hadoop I talked about the basics of Hadoop.  In this post, I wanted to cover s...


Technical Podcasts I Listen To

There are a few podcasts I tend to listen to as I have time. Since I work with a wide...