diponkar.paul

Diponkar Paul has 14 years of experience in the IT industry and specialized in the Business Intelligence domain, currently working as a Manager of Data Engineering at OMERS, Canada. Throughout his career, he designs and developed medium and large data warehouses and delivered business-critical analytical solutions. He was leading the Toronto PASS Group; which is part of the world's largest data professional community named PASS and Lead of Toronto Data Professionals Community. He got a diverse background and has been working and studying in different Geo locations including Canada, Denmark, the UK, and Sweden. He writes a technical blog and speaks, he loves to share his learning within the community.
  • Interests: Data, Travel, Swimming, Cycling, cross-country skate
  • Blog: http://allaboutdata.ca/
  • Jobs: Senior Data Engineer
  • Skills: Big data, Business Intelligence, Database, ETL, ELT, Data Warehouse

All authors

SQLServerCentral Article

What is OneLake in Microsoft Fabric?

Get ready to be blown away! The highly anticipated Microsoft Build in May 2023 has finally unveiled its latest and greatest creation: the incredible Microsoft Fabric - an unparalleled Data Intelligence platform that is guaranteed to revolutionize the tech world! fig 1: OneLake for all Data One of the most exciting things in Fabric I […]

★ ★ ★ ★ ★ ★ ★ ★ ★ ★

4.5 (4)

You rated this post out of 5. Change rating

2023-07-26

4,477 reads

SQLServerCentral Article

How do you secure sensitive data in a modern Data Warehouse?

In 2019 Canadian Broadcasting Corporation (CBC) news reported a massive data breach at the Desjardins Group, which is a Canadian financial service cooperative and the largest federation of credit unions in North America. The report indicated, a "malicious" employee copied sensitive personal information collected by Desjardins from their data warehouse. The data breach compromised the […]

★ ★ ★ ★ ★ ★ ★ ★ ★ ★

4 (2)

You rated this post out of 5. Change rating

2022-03-30

2,924 reads

SQLServerCentral Article

How to Recover a Corrupted Azure Data Factory Integration Runtime

I would like to share my recent experience with Azure Data Factory (ADF) where AutoResolveIntegrationRuntime become corrupted and how did I recover it. I still don't know how the Integration Runtime (IR) was corrupted. However, if it happens, then this article will help you to solve the issue. Problem In general, the ADF AutoResolveIntegrationRuntime should […]

★ ★ ★ ★ ★ ★ ★ ★ ★ ★

5 (1)

You rated this post out of 5. Change rating

2021-11-05

2,831 reads

SQLServerCentral Article

How to Flatten JSON in Azure Data Factory?

When you work with ETL and the source file is JSON, many documents may get nested attributes in the JSON file. Your requirements will often dictate that you flatten those nested attributes. There are many ways you can flatten the JSON hierarchy, however; I am going to share my experiences with Azure Data Factory (ADF) […]

★ ★ ★ ★ ★ ★ ★ ★ ★ ★

4.5 (2)

You rated this post out of 5. Change rating

2021-09-17

18,484 reads

SQLServerCentral Article

Handling Row-level Errors in ADF Data Flows

If you are working with ADF (Azure Data Factory) data flows, then you may have noticed there was a new feature released in November 2020, which is useful to capture any error while inserting/updating the records in a SQL database. This article will describe how to setup the error row handling feature and why it's […]

★ ★ ★ ★ ★ ★ ★ ★ ★ ★

5 (1)

You rated this post out of 5. Change rating

2021-06-16 (first published: )

4,972 reads

All authors

Blogs

Migrate datetime data to datetimeoffset with AT TIME ZONE

By

I recently reviewed, worked on, and added a similar example to the DATETIMEOFFSET Microsoft...

The Comprehensive Guide to Mastering Your SQL DBA Skills

By

Database administrators (DBAs) are the backbone of data-driven organizations. If you're looking to break...

Friday Basics: Authentication vs. Authorization

By

Another security fundamentals topic is authentication versus authorization. For those who have a clear...

Read the latest Blogs

Forums

The OS returned the error '(null)' while attempting 'DeleteFile' filestream.hdr

By lmarkum

I have a SQL Server 2019 Enterprise Edition on CU 25. It has in-memory...

Take Care

By Grant Fritchey

Comments posted to this topic are about the item Take Care

Performance

By LearningDBA

Experts, I am learning some skills so I can troubleshoot some performance-related issues. I...

Visit the forum

Question of the Day

Two Table Hints

What happens when I run this code: 

SELECT
  p.ProductName
, p.ProductCategory
FROM dbo.Product AS p WITH (NOLOCK, TABLOCK);

See possible answers