One of the core components of the Hadoop framework and responsible for the storage aspect is HDFS. Unlike the usual storage available on our computers, HDFS is a Distributed File System and parts of a single large file can be stored on different nodes across the cluster. Here are some of the key concepts related to HDFS.
2014-03-14
4,123 reads
If we want to incorporate big data into our enterprise, it's crucial to know how to integrate it with our existing data.
2014-03-06
5,076 reads
Ask database administrators how they implement disaster recovery in their big data environments and you'll get two typical responses: DR plans are not necessary and backups take up a lot of space. Despite this reasoning, a disaster recovery plan for your big data implementation may be essential for your company's future.
2014-02-04
4,531 reads
Big data is now a standard part of information technology architecture for most large organizations. As a database administrator, with the holiday season upon us, I have the following items and notions on my holiday wish list. Here's hoping that I am gifted one or more of these; each one gives me something that I want or need.
2013-12-31
4,492 reads
Big Data implementations bring their own problems and issues, and will require database administrators and support staff to redesign the data warehouse architecture. Here's how.
2013-12-02
4,609 reads
Distributed applications are just that: distributed across one or more hardware platforms across the enterprise. The database administrator (DBA) has the unenviable task of monitoring these environments and configuring and tuning the database server to meet multiple needs. As multiple distributed applications now require access to a very large data store, what tuning options are available to help?
2013-10-31
3,024 reads
Big data is the latest craze. Hardware and software vendors have overwhelmed IT departments with high-speed analytical software, proprietary high-performance hardware, and columnar-based data stores promising quick access and lightning-fast answers to ad hoc analytical queries. Forgotten in this blast of technology are the database administrators' most important responsibilities: backup and recovery.
2013-10-01
3,853 reads
Many IT enterprises are starting pilot projects to implement big data solutions. This article highlights what you need to know to check if you're ready to support these efforts, and integrate them into your current architecture, processes, and standards.
2013-08-02
3,540 reads
Database Administrators must now deal with large volumes of data and new forms of high-speed data analysis. If your responsibility includes performance tuning, here are the areas to focus on that will become more and more important in the age of Big Data.
2013-07-02
3,463 reads
The big data revolution seems to have failed to materialise, and for good reason - it's really difficult.
2013-02-18
189 reads
Running AI and data pipelines on the edge instead of the cloud has gone...
By Steve Jones
While writing another post I realized my UNION query didn’t work as one might...
By James Serra
Since the release of my book Deciphering Data Architectures: Choosing Between a Modern Data...
Comments posted to this topic are about the item Secure Cached Plans
Comments posted to this topic are about the item Complex Data Processing with dbt...
Comments posted to this topic are about the item Over or Under Provisioned
The DMV, sys.dm_exec_cached_plans, contains rows for each cached plan on an instance. In Azure SQL Database, not every used has rights to every database, as there does exist an instance behind each database. How is security handled for this DMV in Azure?
See possible answers