This is what you build to juggle 6,000 tweets a second. That's the headline that caught my eye and it's about the challenges of Twitter and the data that they handle. Twitter definitely has a tough problem, one that few of us have, but perhaps they can help us learn to better deal with our own data from their experiences on an edge case.
The story is journalistic, not so technical, but it is interesting. Twitter has struggled with a blend of data that is partially crucial and must be consistent now (usernames) and other data that can be a bit out of date (tweets). They also have lots of unstructured data (photo/video) that is combined with more traditional, structured data. They've used a few different database platforms to store this data and assemble it with their application. That's the same things that most of us also do when we deal with many different types of data.
However Twitter is trying to find away around dealing with disparate systems. They've had a number of engineers working on Manhattan, their database designed to handle both structured and unstructured data. And because they work for Twitter, this platform is designed to manage all of this data with very high workload demands at scale.
It will be interesting to see if they come up with any innovative ideas. Certainly SQL Server already has options for managing structured and unstructured data, though perhaps not at the scale Twitter needs.
Free Download -Eight Steps to Efficient SQL Server Monitoring
Read this free guide to getting started with efficient SQL Server Monitoring. If you're a new DBA, or just need a refresher on some of the finer points, this guide has essential information for learning to monitor your servers. Get it here.
Get your SQL Server database under version control now!
Version control is standard for applications, but databases haven’t caught up. So how can you bring database development up to speed? Why should you start? Find out…
Mistakes happen with deploying database changes
Little mistakes when writing manual scripts to deploy database changes can transform into huge time sinks. Use SQL Compare to compare and deploy schema changes - it's relentlessly tested, easy to use, and saves time. Check it out with a free trial.
The output from the Association Rules data mining model in SSAS 2012 can be difficult to understand, especially when the generated rules become more complex. In this tip we go through an example to provide a better understanding. More »
The 2012 release of SQL Server is the most significant one since 2005 and introduces an abundance of new features. This critical book provides in-depth coverage of best practices for troubleshooting performance problems based on a solid understanding of both SQL Server and Windows internals and shows experienced DBAs how to ensure reliable performance. The team of authors shows you how to master the use of specific troubleshooting tools and how to interpret their output so you can quickly identify and resolve any performance issue on any server running SQL Server. Get your copy from Amazon today.
Yesterday's Question of the Day
(by Steve Jones):
In what editions of SQL Server 2014 are memory-optimized tables available?
Answer: Evaluation, Developer, and Enterprise
Memory-optimized tables (formerly known as Hekaton) are available in Enterprise editions, as well as evlauation and developer editions.
Negative run_duration values in msdb..sysjobhistory
- We have noticed some negative values in the [i]run_duration [/i] column of the msdb..sysjobhistory catalog view:
I am trying to find if anyone has experience in datacenter migration. I am currently working on a project...
MAXDOP query hint takes Priority or RESOURCE GOV?
- Hi everyone,
I wanted to ask the group's personal experience with resource gov and query hint w/maxdop.
They are two conflicting statements?...
Table values parameters
- Hi everyone.
Is it possible to have a procedure like this
create procedure usp_test
(@EMPObj As [testdb].[EMPTBL] Readonly, @ADRObj as [testdb].[AddressTBL] readonly)
This newsletter was sent to you because you signed up at SQLServerCentral.com.
Feel free to forward this to any colleagues that you think might be interested.
If you have received this email from a colleague, you can register to receive it here.