data engineering

SQLServerCentral Article

Step by Step Guide to Install Jupyter Notebook

  • Article

Whether you work as a Data Engineer or a Data Scientist, a Jupyter Notebook is a helpful tool. One of the projects I was working required a comparison of two parquet files. This is mainly a schema comparison, not a data comparison. Though the two .parquet were created from two different sources, the outcome should […]

You rated this post out of 5. Change rating

2021-05-17

4,316 reads

SQLServerCentral Article

Dynamically Add a Timestamp To Files in Azure Data Factory

  • Article

This article will describe how to add your local timestamp at the end of the each file in Azure Data Factory (ADF). In general, ADF gets a UTC timestamp, so we need to convert the timestamp from UTC to EST, since our local time zone is EST. For example, if the input Source file name […]

5 (2)

You rated this post out of 5. Change rating

2021-04-22

21,958 reads

SQLServerCentral Article

Google Cloud Certification for Microsoft Database Engineer

  • Article

Introduction I recently passed the Google Cloud Professional Data Engineer certification exam, Professional Data Engineer Certification. It took me about five month to prepare for this, and I would like to share my thoughts of why I decided to take it on and how I prepared for it. At the moment, Google cloud (GCP) is […]

5 (7)

You rated this post out of 5. Change rating

2021-03-15

9,425 reads

Blogs

Microsoft Announcement: Microsoft Fabric

By

Yesterday at Microsoft Build, a significant announcement took place—the introduction of Microsoft Fabric, which...

Introduction to SQL Server Query Store

By

Introduced with SQL 2016, Query Store was, probably without doubt, the most anticipated and...

Flyway with Multiple Folders

By

A customer asked about how they could organize their migration scripts in different ways...

Read the latest Blogs

Forums

You have an error in your SQL syntax; check the manual that corresponds

By yrstruly

I am having great trouble creating a data pipeline using MariaDB connector 3 with...

Availability Group database went into 'Restoring' state

By Arsh

Dear Friends, Please advise why would one of my Availability Group databases go into...

Access db

By sqlguru

Access db wanting to move  sql server, how much control does business have over...

Visit the forum

Ask SSC Logo Ask SSC

SQL Server Q&A from the SQLServerCentral community

Get answers