(2020-Apr-06) Traditionally I would use data flows in Azure Data Factory (ADF) to flatten (transform) incoming JSON data for further processing. Recently I've found a very simple but very effective...
2020-04-14 (first published: 2020-04-06)
3,688 reads
(2020-Mar-30) Little did I know that I can use Azure Data Factory (ADF) to extract data from the Common Data Services (CDS). This data platform enables you to securely store...
2020-04-07 (first published: 2020-03-30)
2,382 reads
(2020-Mar-26) There are two ways to create data flows in Azure Data Factory (ADF): regular data flows also known as "Mapping Data Flows" and Power Query based data flows also...
2020-04-01 (first published: 2020-03-26)
864 reads
(2020-Mar-19) Recently, Microsoft introduced a new Flatten task to the existing set of powerful transformations available in the Azure Data Factory (ADF) Mapping Data Flows - https://docs.microsoft.com/en-us/azure/data-factory/data-flow-flatten.What this new task does...
2020-03-26 (first published: 2020-03-19)
3,867 reads
(2020-Mar-15) Video recording of my webinar session on Using Azure Data Factory Mapping Data Flows to populate Data Vault at the recent PASS Data Architecture Virtual Group meeting.It was based...
2020-03-24 (first published: 2020-03-15)
449 reads
(2020-Feb-04) I didn't name this blog post as "Performance Tips" since I'm just creating the list of helpful notes for myself for tuning the performance of my workload with delta...
2020-02-14 (first published: 2020-02-04)
1,490 reads
(2020-Jan-28) This blog post is a followup to my previous post about DevOps (CI/CD) for Azure Data Factory - Continuous integration and delivery (CI/CD) in Azure Data Factory using DevOps and...
2020-02-04 (first published: 2020-01-28)
3,355 reads
(2019-Dec-15) While working on data integration projects and using Azure Data Factory as your main orchestration tool will help you to develop strategic forward thinking about your development tasks: to...
2019-12-31 (first published: 2019-12-16)
4,950 reads
(2019-Nov-10) Microsoft has recently announced a public preview of the Wrangling data flows in Azure Data Factory (ADF). What used to be called Power Query in Excel, Query Editor in Power...
2019-11-19 (first published: 2019-11-10)
1,988 reads
(2019-Oct-27) Creation or deletion files in your Azure Storage account may initiate data ingestion process and will support your event-driven data platform architecture. Image by Lars_Nissen_Photoart from PixabayMicrosoft recently introduced an...
2019-11-05 (first published: 2019-10-28)
710 reads