When you work with ETL and the source file is JSON, many documents may get nested attributes in the JSON file. Your requirements will often dictate that you flatten those nested attributes. There are many ways you can flatten the JSON hierarchy, however; I am going to share my experiences with Azure Data Factory (ADF) […]
2021-09-17
2,354 reads
There is a Power Query activity in SSIS and Azure Data Factory, which can be more useful than other tasks in some situations.
2021-07-26
2,710 reads
If you are working with ADF (Azure Data Factory) data flows, then you may have noticed there was a new feature released in November 2020, which is useful to capture any error while inserting/updating the records in a SQL database. This article will describe how to setup the error row handling feature and why it's […]
2021-06-16 (first published: 2021-05-02)
1,627 reads
Whether you work as a Data Engineer or a Data Scientist, a Jupyter Notebook is a helpful tool. One of the projects I was working required a comparison of two parquet files. This is mainly a schema comparison, not a data comparison. Though the two .parquet were created from two different sources, the outcome should […]
2021-05-17
3,279 reads
This article will describe how to add your local timestamp at the end of the each file in Azure Data Factory (ADF). In general, ADF gets a UTC timestamp, so we need to convert the timestamp from UTC to EST, since our local time zone is EST. For example, if the input Source file name […]
2021-04-22
5,814 reads
This article will help you to work with Store Procedure with output parameters in Azure data factory.
2021-04-06
6,694 reads
2021-01-14
10,855 reads
This post will describe how you use a CASE statement in Azure Data Factory (ADF). If you are coming from SSIS background, you know a piece of SQL statement will do the task. However let's see how do it in SSIS and the very same thing can be achieved in ADF. Problem statement For my […]
2020-11-12
6,505 reads
By DataOnWheels
For anyone who read the title of this and immediately thought, “Oh no, I...
By Kevin3NF
TLDR: Nope. Keep on doing your full backups. Make sure that any databases you...
By Steve Jones
I started to add a daily coping tip to the SQLServerCentral newsletter and to...
Hello everyone! We have a small group of users (4) using MS Access 2000...
The picture is showing the results that I used sp_spaceused for OldTable and NewTable,...
I have had a server crash and although I was able to recover the...
Ask SSC