Archive to the Lake
Microsoft Fabric changes the paradigm for how you might store data in your warehouse.
2023-08-07
192 reads
Azure Data Lake
Database Deployment with Terraform - Modules
Deploy resources in Azure using reusable code with Terraform modules.
2022-10-10
11,335 reads
2022-07-06
341 reads
Implementing ETL Logging on Lakehouse using Delta Lake's Time Travel capability
In this article I demonstrate how to use Delta Lake's time travel functionality for ETL logging along with steps to take to implement.
2022-07-01
Dynamically Add a Timestamp To Files in Azure Data Factory
This article will describe how to add your local timestamp at the end of the each file in Azure Data Factory (ADF). In general, ADF gets a UTC timestamp, so we need to convert the timestamp from UTC to EST, since our local time zone is EST. For example, if the input Source file name […]
2021-04-22
28,488 reads
Processing Data Using Azure Data Lake, Azure Data Analytics, and Microsoft’s Big Data Language U-SQL
Data analytics has become one of the powerful domains in the world of data science. An enormous amount of data is being generated by each organization in every sector. Computer science has found solutions to store and process this data in a smart way through a distributed file system. One such example is Azure Data Lake. It uses the Hadoop Distributed File System, and to perform analytics on this data, Azure Data Lake storage is integrated with Azure Data Analytics Service and HDInsight. In this article, Suhas Pande will explain how to store data using Azure Data Lake and how to perform data analysis on it using U-SQL, a big data SQL and C# language.
2019-04-29
Processing Data Using Azure Data Lake, Azure Data Analytics, and Microsoft’s Big Data Language U-SQL
Data analytics has become one of the powerful domains in the world of data science. An enormous amount of data is being generated by each organization in every sector....
2019-04-09
Guide to Quickly Creating an Azure Data Lake Storage
Read a step by step guide to setting up an Azure Data Lake Storage account.
2021-02-05 (first published: 2019-03-19)
5,371 reads
Azure Data Lake Analytics using U-SQL Queries
This article will help with gaining confidence and familiarity with Microsoft Azure's Data Lake Analytics offering to process large datasets quickly while demonstrating the potential and capabilities of U-SQL to aggregate and process big data files.
2019-02-20
2,259 reads
Update an Azure SQL Data Mart with ADLS files
In this tip we learn how to update the Azure SQL Data Mart in an automated way.
2019-01-01
1,758 reads
Blogs
Why Data Analysts Love PostgreSQL (and You Will Too!)
Data analysis is all about wrangling massive datasets. To do that efficiently, you need...
How to Connect Your WordPress Site to the Fediverse
By Rob Sewell
Make it easier for your audience to engage with you by connecting your site...
What I learned volunteering at a children's summer camp
By Rayis Imayev
"Stories are where memories go when they are forgotten" - Doctor Who.(2024-Sep-13) As September quickly...
Forums
GIT Configuration and Automated Release for Azure Data Factory
Comments posted to this topic are about the item GIT Configuration and Automated Release...
How to Add a New Shared Disk to a WSFC as a SQL Resource
Comments posted to this topic are about the item How to Add a New...
AI Sings the Blues
Comments posted to this topic are about the item AI Sings the Blues
Question of the Day
Disabling Indexes
I want to disable an index so that it doesn't use any resources and isn't maintained. I am planning to drop this, but don't want to do it now. The index is named LoggerNCI and was created on the dbo.Logger table, on the LogID column. What code disables this?
See possible answers