diponkar.paul

Diponkar Paul has 14 years of experience in the IT industry and specialized in the Business Intelligence domain, currently working as a Manager of Data Engineering at OMERS, Canada. Throughout his career, he designs and developed medium and large data warehouses and delivered business-critical analytical solutions. He was leading the Toronto PASS Group; which is part of the world's largest data professional community named PASS and Lead of Toronto Data Professionals Community. He got a diverse background and has been working and studying in different Geo locations including Canada, Denmark, the UK, and Sweden. He writes a technical blog and speaks, he loves to share his learning within the community.
  • Interests: Data, Travel, Swimming, Cycling, cross-country skate
  • Blog: http://allaboutdata.ca/
  • Jobs: Senior Data Engineer
  • Skills: Big data, Business Intelligence, Database, ETL, ELT, Data Warehouse

SQLServerCentral Article

Handling Row-level Errors in ADF Data Flows

If you are working with ADF (Azure Data Factory) data flows, then you may have noticed there was a new feature released in November 2020, which is useful to capture any error while inserting/updating the records in a SQL database. This article will describe how to setup the error row handling feature and why it's […]

(1)

You rated this post out of 5. Change rating

2021-06-16 (first published: )

5,684 reads

SQLServerCentral Article

Step by Step Guide to Install Jupyter Notebook

Whether you work as a Data Engineer or a Data Scientist, a Jupyter Notebook is a helpful tool. One of the projects I was working required a comparison of two parquet files. This is mainly a schema comparison, not a data comparison. Though the two .parquet were created from two different sources, the outcome should […]

You rated this post out of 5. Change rating

2021-05-17

5,511 reads

SQLServerCentral Article

Dynamically Add a Timestamp To Files in Azure Data Factory

This article will describe how to add your local timestamp at the end of the each file in Azure Data Factory (ADF). In general, ADF gets a UTC timestamp, so we need to convert the timestamp from UTC to EST, since our local time zone is EST. For example, if the input Source file name […]

(2)

You rated this post out of 5. Change rating

2021-04-22

30,288 reads

SQLServerCentral Article

How to simulate Case statement in Azure Data Factory (ADF) compared with SSIS?

This post will describe how you use a CASE statement in Azure Data Factory (ADF). If you are coming from SSIS background, you know a piece of SQL statement will do the task. However let's see how do it in SSIS and the very same thing can be achieved in ADF. Problem statement For my […]

(2)

You rated this post out of 5. Change rating

2020-11-12

22,524 reads

Blogs

T-SQL Tuesday #198 Invitation: How Do You Detect Data Changes?

By

It's time for T-SQL Tuesday #198! This month's topic is change detection. The post T-SQL...

Understanding Fabric MCP

By

Model Context Protocol, or MCP, is one of those technical ideas that sounds more...

AWS RDS Aurora - our first approach

By

When starting with AWS RDS Aurora for managing relational databases in the cloud, many...

Read the latest Blogs

Forums

SQL Password enforcing

By Andre 425568

Hi to all We have situation at a client where someone is illegally changing...

SQL Password enforcing

By Andre 425568

Hi to all We have situation at a client where someone is illegally changing...

How do I explain that SQL Server should not be used as a code repository?

By Bannister

This week my BI Developer colleague proudly showed me a new Power BI report...

Visit the forum

Question of the Day

Creating a JSON Document III

I have this data in a table called dbo.NFLTeams

TeamID  TeamName       City             YearEstablished
------  --------       ----             ---------------
1       Cowboys        Dallas           1960
2       Eagles         Philadelphia     1933
3       Packers        Green Bay        1919
4       Chiefs         Kansas City      1960
5       49ers          San Francisco    1946
6       Broncos        Denver           1960
7       Seahawks       Seattle          1976
8       Patriots       New England      1960
If I run this code, how many rows are returned?
SELECT TOP 2 
  json_objectagg('Team' : TeamName)
FROM dbo.NFLTeams;

See possible answers