SQLServerCentral - www.sqlservercentral.com

A community of more than 1,600,000 database professionals and growing

Featured Contents

Featured Script

The Voice of the DBA

One Database to Rule Them All

This is what you build to juggle 6,000 tweets a second. That's the headline that caught my eye and it's about the challenges of Twitter and the data that they handle. Twitter definitely has a tough problem, one that few of us have, but perhaps they can help us learn to better deal with our own data from their experiences on an edge case.

The story is journalistic, not so technical, but it is interesting. Twitter has struggled with a blend of data that is partially crucial and must be consistent now (usernames) and other data that can be a bit out of date (tweets). They also have lots of unstructured data (photo/video) that is combined with more traditional, structured data. They've used a few different database platforms to store this data and assemble it with their application. That's the same things that most of us also do when we deal with many different types of data.

However Twitter is trying to find away around dealing with disparate systems. They've had a number of engineers working on Manhattan, their database designed to handle both structured and unstructured data. And because they work for Twitter, this platform is designed to manage all of this data with very high workload demands at scale.

It will be interesting to see if they come up with any innovative ideas. Certainly SQL Server already has options for managing structured and unstructured data, though perhaps not at the scale Twitter needs.

Steve Jones from SQLServerCentral.com

Join the debate, and respond to today's editorial on the forums


The Voice of the DBA Podcast

Listen to the MP3 Audio ( 1.9MB) podcast or subscribe to the feed at iTunes and LibSyn. feed

The Voice of the DBA podcast features music by Everyday Jones. No relation, but I stumbled on to them and really like the music. Support this great duo at www.everydayjones.com.

Everyday Jones

Follow Steve Jones on Twitter to find links and database related items and announcements.

ADVERTISEMENT
sqlmonitor

Free Download -Eight Steps to Efficient SQL Server Monitoring

Read this free guide to getting started with efficient SQL Server Monitoring. If you're a new DBA, or just need a refresher on some of the finer points, this guide has essential information for learning to monitor your servers. Get it here.

SQL Source Control

Get your SQL Server database under version control now!

Version control is standard for applications, but databases haven’t caught up. So how can you bring database development up to speed? Why should you start? Find out…

sqlcompare

Mistakes happen with deploying database changes

Little mistakes when writing manual scripts to deploy database changes can transform into huge time sinks. Use SQL Compare to compare and deploy schema changes - it's relentlessly tested, easy to use, and saves time. Check it out with a free trial.

Featured Contents

 

XML Schema validation in SQL Server

Eirikur Eiriksson from SQLServerCentral.com

An introduction to the XML Schema Collection and XML validation. More »


 

Explaining the Calculations of Probability and Importance for Complex Association Rules in SSAS

Additional Articles from MSSQLTips.com

The output from the Association Rules data mining model in SSAS 2012 can be difficult to understand, especially when the generated rules become more complex. In this tip we go through an example to provide a better understanding. More »


 

Call for participants in deployment process research

Press Release from SimpleTalk

The Red Gate Database Delivery team is looking for people willing to participate in UX sessions for an exciting, brand new product, with $50 Amazon vouchers for participants. More »


 

From the SQLServerCentral Blogs - The One Million Row T-SQL Test Harness

Dwain Camps from SQLServerCentral Blogs

So far in our blogs, we have talked a bit about performance, but today we’re going to show you a... More »

Question of the Day

Today's Question (by Steve Jones):

What is the buffer pool extension in SQL Server 2014?

Think you know the answer? Click here, and find out if you are right.


We keep track of your score to give you bragging rights against your peers.
This question is worth 1 point in this category: SQL Server 2014.

We'd love to give you credit for your own question and answer.
To submit a QOTD, simply log in to the Contribution Center.

ADVERTISEMENT

Professional SQL Server 2012 Internals and Troubleshooting

The 2012 release of SQL Server is the most significant one since 2005 and introduces an abundance of new features. This critical book provides in-depth coverage of best practices for troubleshooting performance problems based on a solid understanding of both SQL Server and Windows internals and shows experienced DBAs how to ensure reliable performance. The team of authors shows you how to master the use of specific troubleshooting tools and how to interpret their output so you can quickly identify and resolve any performance issue on any server running SQL Server. Get your copy from Amazon today.

Yesterday's Question of the Day

Yesterday's Question (by Steve Jones):

In what editions of SQL Server 2014 are memory-optimized tables available? 

Answer: Evaluation, Developer, and Enterprise

Explanation:

Memory-optimized tables (formerly known as Hekaton) are available in Enterprise editions, as well as evlauation and developer editions.

Ref: Requirements for Using Memory-Optimized Tables - http://msdn.microsoft.com/en-us/library/dn170449%28v=sql.120%29.aspx


» Discuss this question and answer on the forums

Featured Script

Dynamic table unpivot

kast218 from SQLServerCentral.com

EXECUTE [usp_TableUnpivot] @databaseName = '',

@schemaName = 'dbo',

@tableName = 'TableName',

@unpivotColumns = 'UnpivotColumnName', /*!!! table columns list for unpivot with comma separator without spaces !!!*/

@excludeColumns = 'TableNameID', /*!!! table columns list for excluding with comma separator without spaces !!!*/

@constantColumns = ', ''Constant1'' AS ConstantColumnName1, ''Constant2'' AS ConstantColumnName2', /*!!! constant values !!!*/

@debug = 1; /*!!! only generate sql statement without executing it !!!*/

More »

Database Pros Who Need Your Help

Here's a few of the new posts today on the forums. To see more, visit the forums.

SQL Server 2014 : Development - SQL Server 2014

Cannot deploy cube -analysis services tutorial- - 0 I am a first time SQL server user trying to do the Analysis Services Tutorials. I am on the...


SQL Server 2012 : SQL 2012 - General

SQL Server 2012 latest multiple db restore script - Hi, I'm testing a SQL server 2012 instance and I'm bringing a lot of SQL server 2005 databases, using backup/restore method,...

Find out which store procedures were fired - Our company purchased a app. Is there any way to find out which store procedures were fired once a button was...

Negative run_duration values in msdb..sysjobhistory - We have noticed some negative values in the [i]run_duration [/i] column of the msdb..sysjobhistory catalog view: [code="sql"] SELECT SJH.run_duration , JOB.[name] FROM msdb.dbo.sysjobs JOB INNER JOIN...

TEMPDB High avg write wait time(145ms) on Data files. Suspect Sharepoint might be the culprit any advice appreciated. - Hi all, I am currently investigating aa high avg write time ms issue (145ms) which seems to be only occuring...

SQL Agent Job Owner - I have read here and elsewhere that it is best practice to set the job owner to the sa account,...

Get Table Structure of Stored Procedure Output Table - To get the results of a stored proc into a table you always had to know the structure of the...

Need help in SSIS. - Hi, I need find out the number of columns in flat file before i process that particular file. I have file name...

SQL 2012 - SQL Connections not getting Closed by Client Application and Impact Feedback Request - Hi all, I have been investigating the number of connections active\inactive to a certain database server and I have stumbled across...

VMWare snapshot breaks windows 2012 Cluster - Hi, We have set up SQL server 2012 alwaysOn availability group on windows 2012. It runs and fails over successfully. Recently,...

Can't get CLR to Deploy to SQL 2012 CU2 - Start a project on my Dev Server. SQL 2012 with CU1 and CU2 are installed on both Coding Server and Dest...


SQL Server 2012 : SQL Server 2012 - T-SQL

Code to reduce rows in sample db - Hi guys, does any one have a good idea(or code) to reduce the size of live data so it can...

Get original order quantities and dates, and find any changes or additions to quantities in subsequent order version(s) - I am due to work on this problem, but I have a lot of trouble trying to figure out how...

Monitor Recompile Plan Guides - Hi all, to tune queries from a third party app, I've auto-created a lot of recompile plan guides from an automated...

How to Get the Column Used in where condition in a Procedure - Is there any way to get the Columns Used in where condition in a procedure using SQL?

Service Broker Error... The certificate's private key cannot be found - Hi, I am by no means an expert on SB, but I thought I had my head around it until this...


SQL Server 2008 : SQL Server 2008 - General

Datacenter Migration - Hello, I am trying to find if anyone has experience in datacenter migration. I am currently working on a project...

MAXDOP query hint takes Priority or RESOURCE GOV? - Hi everyone, I wanted to ask the group's personal experience with resource gov and query hint w/maxdop. http://technet.microsoft.com/en-us/library/ms181714.aspx They are two conflicting statements?...

Creating an SSIS package to generate an XML output file - I have created a SSIS package to generate an XML output file. The package run without any errors. The problem...

max degree of parallelism / statistics - Hi Everyone, I have been reviewing at a nightly SQL Server optimisation Job we have running on our Navision/DynamicsNav database. My...

Table values parameters - Hi everyone. Is it possible to have a procedure like this [code="sql"] create procedure usp_test (@EMPObj As [testdb].[EMPTBL] Readonly, @ADRObj as [testdb].[AddressTBL] readonly) -- using...

Looking for elegant solution! Finding match over multiple rows - Hi everyone, I have a new requirement that I'm not seeing an elegant way to capture this data. Everything right now...

Sql network name - Hello everyone I have 2 new servers WS 2012 R2 in cluster, on them i installed 2 instances in cluster SQL...

Use SSIS or SQL Server Agent to post to HTTPS site - I have a SSIS package that modifies a vendor-generated .txt report. Now I need to automatically publish (post or push)...

SSIS package connecting to multiple remote servers - Hi All, I have a central SSIS package that connects to ~360 remote servers to pull back some data. The...

how to declare a variable - Hi.... Iam having two tables in that first table consists of id,name,age,gender,and so on... and in second table it consists of...

SORT_IN_TEMPDB - What is SORT_IN_TEMPDB ? what is the use of it? BOL says [code="other"]When SORT_IN_TEMPDB is not specified, the sort runs are stored...

SQL script to LOOP in and find sequence gap on Unique column - Need help !!! Example of table structure : CREATE TABLE [dbo].[MaintenanceTable]( [TableName] [varchar](50) NOT NULL, [Note] [varchar](250) NULL, [MaintenanceOrder] [int] NOT NULL, CONSTRAINT [PK_ReplicationTableMaintenance] PRIMARY...

Duplicate Rows Withe Percentage - Hello I need to do this task, i have a table with several numeric values, and for each row i need...

Potential Locking Issue - Inserts Failing Due to Duplicate Values - I have an interesting issue. I have a very old database that I am managing that at one point in...

recursive structure. - We have a table containing a 'recursive' structure. Metadata: Parentname, Childname, A child 'points' to a parent. Starting at a topparent (level 0), I want...

Query optimization help - I have one simple query to optimize but somehow after creating couple of index this query is still having more...

How can I find a sql statement executed on a single table? - All, I have a very large web app with inbedded sql that I cannot find. This sql needs to be changed...

script to find the roles - i need to prepare the audit report for 2005 and 2008 servers and also the report is in same format...

SQL Server Read ismore - Insert into Table Select * from anothertable where somecondition in(select some_condition from thirdtable) While doing this operation i see there are more reads...

xp_create_subdir for non-sysadmins - Hi, Is it possible for non-sysadmins to run xp_create_subdir on the Express version of 2008 R2? When researching the subject I...

SQl Server R2 Enterprise Evaluation link anyone? - Hi, Anyone got a link or is hosting the older 2008 R2 enterprise evaluation version, I need to load up an...

SQL Server 2008R2 Evaluation edition download link - Hi, I am trying to find the free trail version of SQL Server 2008 R2 Evaluation edition but no success.I...


SQL Server 2008 : T-SQL (SS2K8)

2008 r2 t-sql call stored procedure with 3 parameters - In t-sql 2008 r2 I need execute a stored procedure called StudentData and pass 3 parameter values to the stored...

Return Primary Key from "updated" record of Merge statement - Hi All, I'm using a Merge statement to update/insert values into a table. The Source is not a table, but the...

Selecting Data by Date for last five days AND avoiding weekend dates - What I am trying to do: Obtain attendance percentages for schools for the last five days. The outcome would look...

Using CAST or CONVERT to change data from string to datetime - I am trying to take a field that has part of a date in it, so I have to parse...

how to load data from flat file source into oledb destination by changing the data types in ssis - i have an source file and i have to load it into the data base by changing datatype of the...

How to count "Out of" for each row ? - Good Morning All, I was looking for advice/help on how to count the number of values that exist in a row...

First and Last Day Prior Month as Input Parameters - I have to create a report and I want all activity for the previous month. I need to calculate the First...

Create Dynamics view - I have view somthing like Create view All_employee AS SELECT Emp_Name, Emp_code FROM dbo.Employee UNION ALL SELECT Emp_Name, Emp_code FROM Emp_201402.Employee But...

error with SP Execution - Hi, I am having SP where I am pulling data from linked server. Previously its working fine but suddenly started to...

Selecting Data from table with multiple conditions on multiple columns - Hi, I am facing a problem in writing the stored procedure for multiple search criteria. I am trying to write the query...

Union difficulty - Hi All, I'm trying to take a portion of a stored procedure and perform a union with another table I've created...

How to create a temp table in a procedure rather than usinh INTO #temptable - Hello Please., I am having a quick question to automate something, we have 10 procedures in Sql server 2008 R, each procedure...


SQL Server 2008 : SQL Server Newbies

Relationships -_- Completely need help - So i have a project for school that i need to make an SQL server. I created the note pad...

Real Time Data Stream - Hello forum. I want to introduce myself as Adam. I am a self starter and self motivated learning. I am...

Execution Script Failure... - I'm attempting to run a script via management studio. Created a new job. Under Job Step Properties, Type was left at...

Linq To Sql, how to show picture from image field by drag - dropping - Hi, all: I used Ling To Sql, OR Designer to drag-drop Employees table from Northwind.mdf and showed all the fields on...

Database Monitoring tool - Hi, Do anyone knows what is the best tool for database monitoring. Basically I need to monitor more than 50 database...


SQL Server 2008 : Security (SS2K8)

Tools - Is there such a tool that will use the security setup from a SQL server, cross-referenced with Active Directory to...

Linked Server using DOMAIN security fails - Hello, I have been attempting to create a linked server but have only been able to get it to work in...

Register SPN for SQL Service account - I am getting the following error message, [i]SSPI handshake failed with error code 0x8009030c, state 14 while establishing a connection...


SQL Server 2008 : SQL Server 2008 High Availability

SQL Virtual Network Name Change Error - I am in the process of configuring a two-node failover cluster for a migration project. We are transitioning a stand-alone...

Copy Job is not working in Log_shipping - Dear All, I have configured the Log Shipping in 2008, Backup Job is running but the Copy Job is not running , It...

cluster-sql service restarted on the same node - I have a active passive cluster.I see the following errors before the sql server got restarted on the same node. [i]Event...

All the 3 jobs are running successfully but Restoration in Secondary server is not happening - Dear All, Am using 2008, I have configured Log Shipping successfully. All the 3 jobs are running successfully but the thing is after...


SQL Server 2008 : SQL Server 2008 Administration

Change the licence to MSDN - Can I use the upgrade feature to change my Enterprise licence to MSDN Enterprise?

Transaction Log Backups Question - Hello, We have a scheduled full backup set for midnight and 30 minute log backups throughout the day. Sometimes our developers trigger...

Error Editing Maintenace Task - I get the following error when attempting to edit a maintenance task: cannot show the editor for this task. Additional information: Exception...

Multiple Job Details - Hi Experts, How can i get the details of multiple jobs like name,last run date & time,last run status ,next run etc....

Restore Database statement - any way to exclude the stored procs? - Hi all, We are restoring databases in a migration but need to do some repointing of the sprocs (to SSIS packages),...

Renaming a filegroup - In one of our production databases a prior DBA made a typo when creating a new file group, does anyone...

In Log shipping Copy Job is not Running successfully... - He Experts... I have Configured Log shipping in SQL server 2008, Copy_Job is not running and throwing an error like the Following...


SQL Server 2008 : SQL Server 2008 Performance Tuning

Weird I/O Problem with server - Across my environment we are seeing sporadic issues appear on our database servers. The issue first appeared about 4 months...

Consolidating Indexes - Hi Guys, I have an index consolidating issue which I have not been able to find a definitive answer to. I have...

LINQ vs SQL Questions - I've run into issues in the past dealing with extremely poorly written queries with LINQ. I've been under the impression...


SQL Server 2005 : Administering

Get OS Username in Trigger - Dear All, User is login to the application using SQL Server Autentication method. I want to get his windows OS username...


SQL Server 2005 : Backups

how the database process and what will happen in backgroud if the On the same point of time differantial and log shiiping occur - how the database process and what will happen in background if the On the same point of time differential and...


SQL Server 2005 : SQL Server 2005 General Discussion

Select all months bewtween two dates - Please help me in finding a query to get all months the between two dates.


SQL Server 2005 : SQL Server 2005 Performance Tuning

how to reduce Wait time on server replies ? - My query shows following statistics: How can i reduce time for Wait time on server replies, i mean what i need...


Reporting Services : Reporting Services

Report Builder 3.0 Problem with filter using IN operator - Hi We have SSRS 2012 and using Report Builder 3.0 and am having problems using the IN operator in a filter. (assume...

SSL Certificate for SSRS - Hi, I need some help on getting an SSL certificate for SQL Server Reporting Services. I've been trying to get...


Reporting Services : Reporting Services 2008 Administration

2008 R2 and 2012 issue - Hello - I have both 2008 R2 and 2012 SSRS installed on the same PC. The 2008 R2 install is Standard...


Reporting Services : Reporting Services 2008 Development

ssrs 2008 r2 dataset call stored procedure - I am modifying an existing SSRS 2008 r2 report. In a dataset that already exists within the ssrs 2008 r2...

Optional cascading parameter problem - This is in SSRS 2012 I'm having problems trying to make a cascading parameter optional. The report requirements are that the...

How to get the Page Footer and Page header from Sub report - I've a main report with page header and page footer and . I'm using a sub report in that which has...


Programming : Connecting

Unable to access server connecting through Tableau - Hello, I have a SQL Server 2008 R2 instance with user accounts, admins, set up for TCP/IP, enabled to connect remotely. On...


Programming : General

Better way to write this query without calling a lookup for each column - Hi All I have a query that needs to evaluate a set of columns (up to 350) and put either a...


Programming : Powershell

Move Logins via SMO - It's possible to create in Powershell, a script that move the login from a source server to a destination server,...

Dynamically creating / evaluating variables - I can't remember where I saw this, and can't find it now :-( I want the value of $cTime to be...


Data Warehousing : Integration Services

Need some helps - Hi All, I have two text files named Jan2014_Sales.txt, and Feb2014_Sales.txt with some data. I need to create a output file...

Records not updated - I have a lookup records that feeds into a OLE DB Command. When I execute everything turns green and the...


SQLServerCentral.com : Anything that is NOT about SQL!

Are the posted questions getting worse? - Is it me, or are the posted questions getting worse these days? I just read a post by someone apparently in...


SQLServerCentral.com : SQLServerCentral.com Website Issues

HTTPS: Perfect Forward Secrecy, SSLv2, cipher suites, wider SSL coverage, IIS version, etc. - After revamping my Firefox cipher suite list (about:config, search for tls and then search for ssl) and adding Calomel SSL...


SQLServerCentral.com : Articles Requested

SELECT ALL USER SECURABLES Permission - How auditors might use this to check what data a person can view.

Truncate and Restores - I am looking for a basic article that shows how truncate affects restores. - a table - a backup with data in...


SQL Server 7,2000 : General

OSQL Not listing All databases - Hi, When i tried to use my database it is saying as [b]cannot open database requested in login login fails [/b] when i...

how to make use of tempdb in sql server 2000 - how to make use of tempdb in sql server 2000 my order by group by queries are done by Tempdb how to...


SQL Server 7,2000 : Security

SQL JOB taking more space - Hi All, One SQL SERVER job has scheduled for morning 3:00 AM , that job is taking 3 to 5 hour to...


Career : Certification

MCSA SQL Server 2012 vs. OCA DBA 11g (Oracle) in time effort and complexity - Hi I passed OCA DBA 11g exams. I have some experience with Oracle, but zero experience with SQL Server. For me was...

MCSA: SQL Server 2012 Training Bundle - Training DVD by Infiniteskills - Hi Did anyone bought "MCSA: SQL Server 2012 Training Bundle - Training DVD by Infiniteskills" from Amazon.com? No Amazon reviews. What do you...

Opinions on Training Providers - My company has finally opened its vast wallet and provided a tiny training budget. Exactly how much is open to...


Career : Employers and Employees

DBA, Data Scientist, Database Engineer. What's the difference? - I'm more interested in your general opinion. I'm not aware of any consensus on this subject but maybe I'm wrong?


Career : Resumes and Job Hunters

Job market in Canada - Hi all, Wondering how the job market is in Canada for SQL DBAs. Which province to choose? Have looked at workopolis...

This email has been sent to {user_email}. To be removed from this list, please click here.
If you have any problems leaving the list, please contact the webmaster@sqlservercentral.com.
This newsletter was sent to you because you signed up at SQLServerCentral.com.
Feel free to forward this to any colleagues that you think might be interested.
If you have received this email from a colleague, you can register to receive it here.
This transmission is ©2014 Red Gate Software Ltd, Newnham House, Cambridge Business Park, Cambridge, CB4 0WZ, United Kingdom. All rights reserved.
Contact: webmaster@sqlservercentral.com