Big Data

Do You Have Big Data?

  • Editorial

Data sizes are always growing. Stats on world data are astounding, as are the stats many of us experience in our lives. Plenty of us have moved from MB management to GBs, and I see plenty of people dealing with TB storage at home. Most of that data is likely from images and video, but […]

2020-09-09

134 reads

Why Would I Ever Need to Partition My Big ‘Raw’ Data?

  • Article

Whether you are running an RDBMS, or a Big Data system, it is important to consider your data-partitioning strategy. As the volume of data grows, so it becomes increasingly important to match the way you partition your data to the way it is queried, to allow 'pruning' optimisation. When you have huge imports of data to consider, it can get complicated. Bartosz explains how to get things right; not perfect but wisely.

2016-11-22

3,345 reads

How to Start Big Data with Apache Spark

  • Article

It is worth getting familiar with Apache Spark because it a fast and general engine for large-scale data processing and you can use you existing SQL skills to get going with analysis of the type and volume of semi-structured data that would be awkward for a relational database. With an IDE such as Databricks you can very quickly get hands-on experience with an interesting technology.

2016-11-18

3,131 reads

The End of Big Data

  • Article

What is next for big data? Some experts claim that data "volumes, velocity, variety and veracity" will only increase over time, requiring more data storage, faster machines and more sophisticated analysis tools. However, this is short-sighted, and does not take into account how data degrades over time. Analysis of historical data will always be with us, but generation of the most useful analyses will be done with data we already have. To adapt, most organizations must grow and mature their analytical environments. Lockwood Lyon shares the steps they must take to prepare for the transition.

2016-06-03

10,764 reads

Blogs

Are You a Diverse User Group or Event?

By

One of the things that I’ve seen crop up at various points in my...

Daily Coping 18 Jun 2021

By

I started to add a daily coping tip to the SQLServerCentral newsletter and to...

When Read Committed Snapshot Goes Bad – Version Store Filling TempDB

By

We all had those calls, it’s the middle of the night and we get...

Read the latest Blogs

Forums

DB logins permission script out

By sqltester1

Hi, Can anyone share or point me to get -DB logins permissions in a...

UniqueIdentifier as Primary Key, non-clustered index, fragmentation issue

By oRBIT

I've been working a little bit with a few tables here, they've got "CreatedDate"...

Multiple deadlocks occuring on simultaneous deletions from temporal table

By zoggling

We have a stored procedure which is attempting to delete 1-2 rows at a...

Visit the forum

Ask SSC

SQL Server Q&A from the SQLServerCentral community

Get answers