Most large organizations have implemented one or more big data applications. As more data accumulates internal users and analysts execute more reports and forecasts, which leads to additional queries and analysis, and more reporting. The cycle continues: data growth leads to better analysis, which generates more reporting. Eventually the big data application swells with so much data and querying that performance suffers.
2015-02-26
11,157 reads
Big data applications are now fairly commonplace in large organizations. It is, however, difficult to simply ‘drop’ these applications into an existing IT infrastructure and expect to run smoothly. In addition to energy and cooling requirements for new hardware to support the new big data application, other IT areas need to prepare.
2014-10-27
9,144 reads
Big Data implementations are more than just lots of data. Of equal importance is the analytics software used to query the data. Analyzing business data using advanced analytics is common, especially in companies that already have an enterprise data warehouse. It is therefore only natural that your big data application must be integrated with the existing warehouse.
2014-09-26
10,283 reads
As the enterprise embraces big data, management assumes that staff sizes will decrease. What should be done with those unneeded technologists? One answer: convert them into technology consultants that collaborate and coordinate with the lines of business. In other words, give them customer-facing roles.
2014-08-26
8,744 reads
Technical support teams usually support familiar hardware and software configurations. Specialization in particular combinations of operating systems and database management software is common, and this allows some team members to gain in-depth experience that is extremely valuable in an enterprise IT setting. How has big data changed this paradigm?
2014-08-04
10,972 reads
Many big data application implementations seem to begin with an existing data warehouse, one or more new high-volume data streams, and some specialized hardware and software. The data storage issue is often accommodated by installing a proprietary hardware appliance that can store huge amounts of data while providing extremely fast data access. In these cases, do we really need to worry about database design?
2014-05-26
5,297 reads
This article outlines how to measure resource usage, and use these measurements to develop quality metrics for Big Data applications.
2014-04-28
4,186 reads
If your companies first foray into Big Data project starts with a big cheque then you are doing it wrong!
2014-04-14
359 reads
Load tests give the database administrator quite a lot of valuable information and may make the difference between poor and acceptable application performance. But are there any gotchas or traps associated with big data?
2014-04-07
4,112 reads
One of the core components of the Hadoop framework and responsible for the storage aspect is HDFS. Unlike the usual storage available on our computers, HDFS is a Distributed File System and parts of a single large file can be stored on different nodes across the cluster. Here are some of the key concepts related to HDFS.
2014-03-14
4,123 reads
Businesses are drowning in data, but starving for insights. That's where SQL experts swoop...
By Brian Kelley
The bottom line here is this: the idea that a CSP takes care of...
In today's data-driven world, SQL (Structured Query Language) is a blazing-hot skill. It's your...
Dears, Hope this message finds you well I did not see in this foruns...
The below code works for backup files only from local drives. When replaced with...
I have been asked to fine-tune the following SQL that was written by a...
What are the initial config sizes for the tempdb primary data files, secondary data files, and log files in SQL Server 2022?
See possible answers