Problems displaying this newsletter? View online.
SQL Server Central
The Voice of the DBA
 

Azure Data Explorer

It seems that every year brings another tool or platform on which we can manipulate data. I sometimes wonder if all the effort to find new ways to work with data would be better served developing better frameworks and reference models for other existing systems. I know this isn’t likely as people often seem to prefer a specialized tool for certain work, especially when they are the ones that want to build one.

I ran across Azure Data Explorer (ADE) last year, but thought of it more as a tool than a platform. As it went GA (generally available) this year, I took a second look and realized this is actually a platform, one that may prove useful to any number of situations that deal with lots of streaming, time series style data.

With the move towards better instrumentation in our software, and more DevOps style approaches to learning from our systems, we are gathering more and more data. Already I see many DBAs and system administrators struggling a bit to work with the overwhelming amount of log data being produced. SQL Server is a great platform, but I’m not sure it’s optimized for lots of streaming log events, many of which we might want to analyze in a very ad hoc manner.

James Serra has a nice introduction to ADE, one that’s only slightly hyped. There is also another short intro from Adatis that might help you understand more about this new service from Microsoft. It appears to be a competitor for LogStash or Splunk, and one that has been used inside Microsoft for years. Now it’s a product, and one that might prove to be more cost effective than hosting (and maintaining) a SQL Server database.

This also seems to be more a staging type area, where you can land some data and transform it into other storage later, either online in a SQL Server (or DW) system, or even process further and drop into a data lake. With SQL Server 2019 looking to make heavy use of external tables and query other formats of data (other than relational), perhaps this a pattern to consider if you ingest large amounts of streaming type data.

I don’t know that ADE makes sense for us at SQLServerCentral, but I could see some of the telemetry and analysis data for Redgate could be useful here. If this scaled down, it might even be a better way to gather and store auditing or logging data from something like XEvents. Unfortunately, the need to keep a cluster in Azure is probably overkill for most of us, but maybe things will change in the future.

I’d be interested to know if any of you plan on trying ADE in your environments. Perhaps you have a wild idea that might suit this type of data platform and want to share your thoughts today.

Steve Jones - SSC Editor

 
Redgate Data Masker
  Featured Contents

Calculating Elapsed Times (SQL Spackle)

dwain.c from SQLServerCentral.com

SQL elapsed times

Calculating elapsed time between time values can be an interesting problem that is easily solved even when data anomalies are present.

How to Implement In-Memory OLTP Quickly and Easily

Additional Articles from Brent Ozar Unlimited Blog

in-memory oltp

When you first hear about it, SQL Server’s In-Memory OLTP sounds like a new feature that’s hard to implement, requires a lot of schema changes, and takes planning and downtime. Here Brent Ozar tells you how it’s simply not true, and you can do it in just 3 steps.

A Database Developer’s Guide to SQL Clone

Additional Articles from Redgate

SQL Clone

Phil Factor explains how SQL Clone works, and its multiple benefits when used in daily development and testing work, as well as for other tasks such as training staff to use a new application.

From the SQL Server Central Blogs - Mixed feelings over the new truncation error

Kenneth.Fisher from SQLServerCentral Blogs

As of SQL 2019 CTP2.0 or SQL 2017 CU12 Microsoft has given us a long-awaited addition to the truncation error….

From the SQL Server Central Blogs - 4 Reasons To Avoid VARCHAR(8000)

Bert Wagner from SQLServerCentral Blogs

Watch this week’s episode on YouTubeWhen first learning SQL Server, I had the brilliant idea of defining every column on…

 

  Question of the Day

Today's question (by Steve Jones - SSC Editor):

 

Getting the columns

I have a database and I call this procedure.
EXEC sys.sp_columns @table_name = 'Articles'
What is returned?

Think you know the answer? Click here, and find out if you are right.

 

Redgate SQL Compare
 

 

  Yesterday's Question of the Day (by Steve Jones - SSC Editor)

Changing the default FTS language

Right now the default language for my full text search is US English on a SQL Server 2017 instance. How do I change this to British English?

Answer: EXEC sp_configure 'default full-text language', 2057

Explanation: To change the default full-text language, sp_configure is used. Ref: Configure the default full-text language Server Configuration Option - https://docs.microsoft.com/en-us/sql/database-engine/configure-windows/configure-the-default-full-text-language-server-configuration-option?view=sql-server-2017

Discuss this question and answer on the forums

 

Database Pros Who Need Your Help

Here's a few of the new posts today on the forums. To see more, visit the forums.


Is there any script (may be poweshell) which can give the details of all require - Experts, When we configure Cluster or AG/Listener most of the times we face some or other issue because of the insufficient permissions on OU for clustername$/machinename$.. etc. As that’s managed by different team and we don’t have access to AD etc. we spend a lot of time on fixing it as the other team always […]
Logos missing? - Minor issue, but wondered if I am the only one to notice the site logo has disappeared?
import a database from premis to RDS - Hello everyone Who has an idea please how can I import a database from premis to RDS? thank you for your help
tags not visible in briefcase - i have saved scripts and some forum discussion topics with tags in briefcase to easily find what i am looking for,instead of going through all the pages and find topics. Is there a way i can find using tags after upgrade
trying to add individuals to a variable call… - Thanks to all that take the time to read or reply… I have this snippet of code and i want to add a individual to the @recipients variable …is this possible? EXEC msdb.dbo.sp_send_dbmail @profile_name = ‘Profile’, @recipients = @Recipients, @copy_recipients = @CopyRecipients, @body = @Body, @body_format = ‘HTML’, @subject = @SubjectName, @file_attachments = @AttachmentPath; i […]
Calculate percentage per family product regarding the total of sales - Hello community, Suppose i want to Calculate percentage per family product regarding the total of sales: Example: Family totalinvoice cost profit Margin Percent acessories 10000 5000 5000 50% (a) material 200 50 150 25% (b) Total sales 10200 I want to do the following calculation : ( acessories (10000) / total sales (10200) ) * […]
Change Domain Name of SQL Server Computer - We have a SQL Server 2016 Enterprise install on a machine in another domain. The SysAdmins are working toward shutting off the domain the machine is in. The machine name isn’t going to change just the domain it is in. The SQL Server service accounts are already running in the target domain. From what I […]
Number of Replies should be actual Replies, not initial question - Right now, any post with only the question asked shows as “Replies: 1”, but that’s a post with no replies at all. Can we make this a zero-based count?
INSERT INTO table if 4 or less occurrences of values exist in table - I want to limit the number of rows that I can insert into a table for a certain value to 4. So I can only have 4 instances of a 1, or 4 instances of a 2 etc. in a table. How do I do that with an INSERT statement? Only INSERT into the table […]
Login Default Database - Hi Can you please provide some suggestion how to prevent user (part of Windows Group) changing the Default Database? All the other user in the group got affect after the user changed default database. Thanks Shuaib
Possible performance issue cause - Every page asks me (at the very bottom) to “take a peek into our servers”. So, I figured why not. I clicked the link ( https://monitor.red-gate.com/overviews/SQLMON-EC2-BM2/cluster/sscdbcluster.ssc.local/sql/ssc-db-n1%5C(local)#?Zoom=1554304217018%2C1554311417018&MaxTime=1554311417018&Present=true ). It took me to a “SQL Monitor Live Demo” page. Neat. It has a list of the “Top 50 queries”. Neat. I scrolled through and found one that […]
How to create an atom xml doc using TSQL - hey guys, I need to select data from a table and put it in an atom xml feed sort of like the following. I can’t seem to find anything online on how to create such a document. 8AD871C1-6DAD-4038-9A36-9997E038F342 […]
Upgrading reports from 2014 server (2016 SSRS server) to 2017 Azure IaaS - The organization is starting a system upgrade cycle moving us to Azure from 2014 local instances. What code smells should I be looking for that are not supported in the cloud but we might be using now? apologies if other posters have already put this out there, I was not able to find any other […]
Unable to send email - I have this code which checks for long running queries and emails me if the query is running for more than 5 minutes. I have set it up for 1 minutes for testing. I run this query which takes more than 1 minute to run but when I execute this stored procedure it doesn’t send […]
Please revert to old site or prevent new content until data loss issues resolved - I know this sounds harsh, and I don’t want to be harsh, but there are 3 major data loss, two of which are non-recoverable: MAJOR ISSUE TO FIX ASAP: data loss for characters not included in code page 1252 MAJOR DATA LOSS ISSUE TO FIX ASAP: code in code block treated as standard HTML New […]
 

 

RSS FeedTwitter

This email has been sent to {email}. To be removed from this list, please click here. If you have any problems leaving the list, please contact the webmaster@sqlservercentral.com. This newsletter was sent to you because you signed up at SQLServerCentral.com.
©2019 Redgate Software Ltd, Newnham House, Cambridge Business Park, Cambridge, CB4 0WZ, United Kingdom. All rights reserved.
webmaster@sqlservercentral.com

 

- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -