Data sizes are always growing. Stats on world data are astounding, as are the stats many of us experience in our lives. Plenty of us have moved from MB management to GBs, and I see plenty of people dealing with TB storage at home. Most of that data is likely from images and video, but […]
2020-09-09
134 reads
Steve talks data virtualization in the age of growing data sets and larger workloads
2020-02-27
238 reads
Why has Microsoft added new capabilities in SQL Server to connect to other types of data sources? Read on to learn more.
2021-05-14 (first published: 2019-09-09)
8,898 reads
When it comes to data warehouse modernization, we’re big fans of moving to the cloud. ...
2019-04-17
The overall importance of data and information within organizations has continued to grow. We’ve also seen the continued rise of megatrends like IoT, big data – even too much...
2019-04-16
For many companies, the initial attraction to Azure Databricks is the platform’s ability to process big data in a fast, secure, and collaborative environment. However, another highly advantageous feature is the Databricks dashboard.
2019-03-30
This post describes how to generate big datasets with Hive in HDInsight, specifically TPC-DS benchmarking datasets. There are many tools for generating sample data, and this one is particularly nice due to its familiarity and ability to generate massive...
2019-03-30
Whether you are running an RDBMS, or a Big Data system, it is important to consider your data-partitioning strategy. As the volume of data grows, so it becomes increasingly important to match the way you partition your data to the way it is queried, to allow 'pruning' optimisation. When you have huge imports of data to consider, it can get complicated. Bartosz explains how to get things right; not perfect but wisely.
2016-11-22
3,345 reads
It is worth getting familiar with Apache Spark because it a fast and general engine for large-scale data processing and you can use you existing SQL skills to get going with analysis of the type and volume of semi-structured data that would be awkward for a relational database. With an IDE such as Databricks you can very quickly get hands-on experience with an interesting technology.
2016-11-18
3,131 reads
What is next for big data? Some experts claim that data "volumes, velocity, variety and veracity" will only increase over time, requiring more data storage, faster machines and more sophisticated analysis tools. However, this is short-sighted, and does not take into account how data degrades over time. Analysis of historical data will always be with us, but generation of the most useful analyses will be done with data we already have. To adapt, most organizations must grow and mature their analytical environments. Lockwood Lyon shares the steps they must take to prepare for the transition.
2016-06-03
10,764 reads
By Steve Jones
One of the things that I’ve seen crop up at various points in my...
By Steve Jones
I started to add a daily coping tip to the SQLServerCentral newsletter and to...
We all had those calls, it’s the middle of the night and we get...
Hi, Can anyone share or point me to get -DB logins permissions in a...
I've been working a little bit with a few tables here, they've got "CreatedDate"...
We have a stored procedure which is attempting to delete 1-2 rows at a...
Ask SSC