(2020-Apr-06) Traditionally I would use data flows in Azure Data Factory (ADF) to flatten (transform) incoming JSON data for further processing. Recently I've found a very simple but very effective...
2020-04-06
3 reads
(2020-Mar-30) Little did I know that I can use Azure Data Factory (ADF) to extract data from the Common Data Services (CDS). This data platform enables you to securely store...
2020-04-07 (first published: 2020-03-30)
137 reads
(2020-Mar-26) There are two ways to create data flows in Azure Data Factory (ADF): regular data flows also known as "Mapping Data Flows" and Power Query based data flows also...
2020-04-01 (first published: 2020-03-26)
320 reads
(2020-Mar-19) Recently, Microsoft introduced a new Flatten task to the existing set of powerful transformations available in the Azure Data Factory (ADF) Mapping Data Flows - https://docs.microsoft.com/en-us/azure/data-factory/data-flow-flatten.What this new task does...
2020-03-26 (first published: 2020-03-19)
433 reads
(2020-Mar-15) Video recording of my webinar session on Using Azure Data Factory Mapping Data Flows to populate Data Vault at the recent PASS Data Architecture Virtual Group meeting.It was based...
2020-03-24 (first published: 2020-03-15)
384 reads
(2020-Feb-04) I didn't name this blog post as "Performance Tips" since I'm just creating the list of helpful notes for myself for tuning the performance of my workload with delta...
2020-02-14 (first published: 2020-02-04)
513 reads
(2020-Jan-28) This blog post is a followup to my previous post about DevOps (CI/CD) for Azure Data Factory - Continuous integration and delivery (CI/CD) in Azure Data Factory using DevOps and...
2020-02-04 (first published: 2020-01-28)
1,102 reads
(2019-Dec-15) While working on data integration projects and using Azure Data Factory as your main orchestration tool will help you to develop strategic forward thinking about your development tasks: to...
2019-12-31 (first published: 2019-12-16)
1,234 reads
(2019-Nov-10) Microsoft has recently announced a public preview of the Wrangling data flows in Azure Data Factory (ADF). What used to be called Power Query in Excel, Query Editor in Power...
2019-11-19 (first published: 2019-11-10)
1,117 reads
(2019-Oct-27) Creation or deletion files in your Azure Storage account may initiate data ingestion process and will support your event-driven data platform architecture. Image by Lars_Nissen_Photoart from PixabayMicrosoft recently introduced an...
2019-11-05 (first published: 2019-10-28)
629 reads
Sometimes in life you have to do things you really don’t like to do....
By HamishWatson
Welcome to the first April edition of T-SQL Tuesday. I’m honoured to be hosting...
By Steve Jones
Last week went a little crazy, and I learned something: don’t post a Zoom...
Hi, I need to include a very simple schema in all of my database...
This is my first time dealing with CLR assemblies and we have setup some...
Hi, I have a requirement to convert a date value like '7th March 2020' ...
Ask SSC