Top big data analytics trends hold true well into 2019
The overall importance of data and information within organizations has continued to grow. We’ve also seen the continued rise of megatrends like IoT, big data – even too much...
2019-04-16
Big Data
Databricks Dashboards: Data Exploration With Salary Classification
For many companies, the initial attraction to Azure Databricks is the platform’s ability to process big data in a fast, secure, and collaborative environment. However, another highly advantageous feature is the Databricks dashboard.
2019-03-30
Generate Big Datasets with Hive in HDInsight
This post describes how to generate big datasets with Hive in HDInsight, specifically TPC-DS benchmarking datasets. There are many tools for generating sample data, and this one is particularly nice due to its familiarity and ability to generate massive...
2019-03-30
Why Would I Ever Need to Partition My Big ‘Raw’ Data?
Whether you are running an RDBMS, or a Big Data system, it is important to consider your data-partitioning strategy. As the volume of data grows, so it becomes increasingly important to match the way you partition your data to the way it is queried, to allow 'pruning' optimisation. When you have huge imports of data to consider, it can get complicated. Bartosz explains how to get things right; not perfect but wisely.
2016-11-22
3,345 reads
How to Start Big Data with Apache Spark
It is worth getting familiar with Apache Spark because it a fast and general engine for large-scale data processing and you can use you existing SQL skills to get going with analysis of the type and volume of semi-structured data that would be awkward for a relational database. With an IDE such as Databricks you can very quickly get hands-on experience with an interesting technology.
2016-11-18
3,131 reads
The End of Big Data
What is next for big data? Some experts claim that data "volumes, velocity, variety and veracity" will only increase over time, requiring more data storage, faster machines and more sophisticated analysis tools. However, this is short-sighted, and does not take into account how data degrades over time. Analysis of historical data will always be with us, but generation of the most useful analyses will be done with data we already have. To adapt, most organizations must grow and mature their analytical environments. Lockwood Lyon shares the steps they must take to prepare for the transition.
2016-06-03
10,764 reads
Big Data Architecture
The next few years will be critical for the information technology staff, as they attempt to integrate and manage multiple, diverse hardware and software platforms. In this article, Lockwood Lyon addresses how to meet this need, as users demand greater ability to analyze ever-growing mountains of data, and IT attempts to keep costs down.
2016-05-09
5,553 reads
Integrating Big Data Applications into Operational Environments
Integrating big data appliance solutions into a data warehouse requires preparation and forethought. DBAs and business data consumers must work together both to address the implementation issues above and to meet the needs of multiple business data consumers. Lockwood Lyon discusses the topic.
2015-12-11
4,993 reads
Hadoop many flavors of SQL
What are the most popular SQL implementations for Hadoop? How different are they from T-SQL?
2015-11-24
5,202 reads
Navigating Hadoop Resources
Learn where to get the latest installation and learning resources for the ever-evolving components of Hadoop ecosystem and how those components may complement Microsoft SQL Server common everyday tasks.
2018-05-04 (first published: 2015-10-01)
4,395 reads
Blogs
Azure – HorizonDB
By Vinay Thakur
As Open Source – PostgreSQL and AI is a growing and powerful DB system,...
A New Chapter: Why I Made the Move from Dayforce to ESO
By gbargsley
A New Chapter: Why I Made the Move from Dayforce to ESO Over the...
Lean Six Sigma – Brief
By Vinay Thakur
When you have a project or system, it has to be optimized, tuned, and...
Forums
ALAMAT KANTOR BCA KCU METRO TLP/WA 0817825533
Hub Cs:0817825533 Jl. Jendral Sudirman No.106, Imopuro, Metro, Kota Metro, Lampung 34111
ALAMAT BCA KCU BANDAR LAMPUNG TLP/WA 0817825533
Hub Cs:0817825533 Jl. Yos Sudarso No.100, Bumi Waras, Kec. Bumi Waras, Kota Bandar Lampung,...
ALAMAT KANTOR BCA KCU JAMBI TLP/WA 0817825533
Hub Cs:0817825533 Jl. Dokter Sutomo No.50-50A, Ps. Jambi, Kec. Ps. Jambi, Kota Jambi, Jambi...
Question of the Day
DBCC CHECKDB Limits II
I have a SQL Server 2025 database that I want to check for corruption every night. One of the things we do is disable indexes used for ETL loads during the weekend and re-enable them on Monday morning. If we run DBCC over the weekend, are our disabled indexes checked for consistency?
See possible answers