SQL Clone
SQLServerCentral is supported by Redgate
 
Log in  ::  Register  ::  Not logged in
 
 
 

Articles with tag Big Data Rss

Search for any content tagged big data

   Items 1 to 20 of 55    Older >>
 

Navigating Hadoop Resources

Learn where to get the latest installation and learning resources for the ever-evolving components of Hadoop ecosystem and how those components may complement Microsoft SQL Server common everyday tasks.  Read more...
By Daniel Klionsky 2018/05/04 (first published: 2015/10/01) | Source: SQLServerCentral.com | Category: big data
Rating: |  Discuss |   Briefcase | 4,211 reads

Stairway to U-SQL Level 20: Querying External Data with U-SQL

Did you know you can query SQL Server data with U-SQL? It's true! Find out how in this latest stairway step.  Read more...
By Mike McQuillan 2018/03/14 | Source: SQLServerCentral.com | Category: azure
Rating: (not yet rated) |  Discuss |   Briefcase | 565 reads

Stairway to U-SQL Level 1: Introduction to U-SQL and Azure Data Lakes

An introductory guide to querying files in Azure Data Lakes using Microsoft's U-SQL language.  Read more...
By Mike McQuillan 2018/01/19 (first published: 2016/06/15) | Source: SQLServerCentral.com | Category: azure
Rating: |  Discuss |   Briefcase | 7,022 reads

Distributed Computing Principles and SQL-on-Hadoop Systems

A look at SQL-On-Hadoop systems like PolyBase, Hive, Spark SQL in the context Distributed Computing Principles and new Big Data system design approach like the Lambda Architecture.  Read more...
By Frank A. Banin 2017/10/26 | Source: SQLServerCentral.com | Category: distributed computing
Rating: |  Discuss |   Briefcase | 623 reads

Stairway to U-SQL Level 18: Populating a Data Lake with PowerShell

Learn how PowerShell can be used to manage files and folders in your Data Lake.  Read more...
By Mike McQuillan 2017/10/04 | Source: SQLServerCentral.com | Category: powershell
Rating: |  Discuss |   Briefcase | 473 reads

Stairway to U-SQL Level 17: Executing U-SQL Jobs with PowerShell

Automate your Data Lake with PowerShell! Learn how PowerShell can be used to execute U-SQL scripts, as well as a few other little tricks.  Read more...
By Mike McQuillan 2017/09/20 | Source: SQLServerCentral.com | Category: u-sql
Rating: |  Discuss |   Briefcase | 537 reads

Stairway to U-SQL Level 16: The Azure Data Lake Catalog

Delve behind the scenes and learn about the catalog used to manage Azure Data Lakes.  Read more...
By Mike McQuillan 2017/08/30 | Source: SQLServerCentral.com | Category: azure
Rating: |  Discuss |   Briefcase | 617 reads

Stairway to U-SQL Level 12: SQL.ARRAY and CROSS APPLY EXPLODE

U-SQL introduces two new data types - SQL.ARRAY and SQL.MAP. Here, we look at what we can do with SQL.ARRAY and the CROSS APPLY EXPLODE expression.  Read more...
By Mike McQuillan 2017/01/11 | Source: SQLServerCentral.com | Category: u-sql
Rating: |  Discuss |   Briefcase | 1,561 reads

Hadoop For SQL Folks: Architecture, MapReduce and Powering IoT

As the de-facto big data processing and analytics engine, the Hadoop ecosystem is also leading the way in powering Internet of Things (IOT)  Read more...
By Frank A. Banin 2016/12/02 (first published: 2015/08/06) | Source: SQLServerCentral.com | Category: hadoop
Rating: |  Discuss |   Briefcase | 10,464 reads

Why Would I Ever Need to Partition My Big ‘Raw’ Data?

Whether you are running an RDBMS, or a Big Data system, it is important to consider your data-partitioning strategy. As the volume of data grows, so it becomes increasingly important to match the way you partition your data to the way it is queried, to allow 'pruning' optimisation. When you have huge imports of data to consider, it can get complicated. Bartosz explains how to get things right; not perfect but wisely.  Read more...
By Additional Articles 2016/11/22 | Source: SimpleTalk | Category: big data
Rating:  Rate this |   Briefcase | 3,153 reads

How to Start Big Data with Apache Spark

It is worth getting familiar with Apache Spark because it a fast and general engine for large-scale data processing and you can use you existing SQL skills to get going with analysis of the type and volume of semi-structured data that would be awkward for a relational database. With an IDE such as Databricks you can very quickly get hands-on experience with an interesting technology.  Read more...
By Additional Articles 2016/11/18 | Source: SimpleTalk | Category: big data
Rating:  Rate this |   Briefcase | 3,000 reads

Stairway to U-SQL Level 11: Stored Procedures

To finish off our look at the core database objects, we inspect how the venerable stored procedure works in U-SQL.  Read more...
By Mike McQuillan 2016/11/16 | Source: SQLServerCentral.com | Category: u-sql
Rating: |  Discuss |   Briefcase | 1,527 reads

Introduction to Microsoft R Services in SQL Server 2016

General introduction to R Services in SQL Server 2016 and how R server works with external stored procedure.  Read more...
By Tomaž Kaštrun 2016/09/15 | Source: SQLServerCentral.com | Category: microsoft
Rating: |  Discuss |   Briefcase | 3,324 reads

Stairway to U-SQL Level 6: U-SQL Indexes and Partition Schemes

Find out how to speed up your queries by indexing and partitioning data, U-SQL style.  Read more...
By Mike McQuillan 2016/08/10 | Source: SQLServerCentral.com | Category: u-sql
Rating: |  Discuss |   Briefcase | 1,459 reads

Stairway to U-SQL Level 5: Databases and Tables in Azure Data Lakes with U-SQL

A guide to using databases, schemas and tables in Azure Data Lakes, using (of course!) U-SQL.  Read more...
By Mike McQuillan 2016/07/27 | Source: SQLServerCentral.com | Category: u-sql
Rating: |  Discuss |   Briefcase | 858 reads

Stairway to U-SQL Level 4: U-SQL and Data Lake Tooling with Visual Studio

A guide to using Visual Studio to create U-SQL projects and scripts.  Read more...
By Mike McQuillan 2016/07/20 | Source: SQLServerCentral.com | Category: u-sql
Rating: |  Discuss |   Briefcase | 1,530 reads

Stairway to U-SQL Level 3: Processing Multiple Files With U-SQL

In part 3 of the U-SQL Stairway, we look at how multiple files can be processed with a single U-SQL statement.  Read more...
By Mike McQuillan 2016/07/06 | Source: SQLServerCentral.com | Category: u-sql
Rating: |  Discuss |   Briefcase | 2,153 reads

Stairway to U-SQL Level 2: Breakdown of a U-SQL Statement

Following on from our introduction to U-SQL, we take a look at how a typical U-SQL statement is constructed.  Read more...
By Mike McQuillan 2016/06/22 | Source: SQLServerCentral.com | Category: usql
Rating: |  Discuss |   Briefcase | 4,058 reads

Stairway to U-SQL Level 1: Introduction to U-SQL and Azure Data Lakes

An introductory guide to querying files in Azure Data Lakes using Microsoft's U-SQL language.  Read more...
By Mike McQuillan 2018/01/19 (first published: 2016/06/15) | Source: SQLServerCentral.com | Category: azure
Rating: |  Discuss |   Briefcase | 7,022 reads

The End of Big Data

What is next for big data? Some experts claim that data "volumes, velocity, variety and veracity" will only increase over time, requiring more data storage, faster machines and more sophisticated analysis tools. However, this is short-sighted, and does not take into account how data degrades over time. Analysis of historical data will always be with us, but generation of the most useful analyses will be done with data we already have. To adapt, most organizations must grow and mature their analytical environments. Lockwood Lyon shares the steps they must take to prepare for the transition.  Read more...
By Additional Articles 2016/06/03 | Source: Database Journal | Category: big data
Rating: (not yet rated)  Rate this |   Briefcase | 10,681 reads
   Items 1 to 20 of 55    Older >>