data engineering

SQLServerCentral Article

Evolving Role of Data Professionals in Artificial Intelligence Era

  • Article

Generative Al tools like Gemini and GPT promise to automate and augment knowledge-based work. Data professionals must adapt to this transformation by acquiring new skills and playing a central role in their organization's AI-driven future. Data preparation, curation, ethical sourcing and labeling, and collecting user feedback become crucial as high-quality data is essential for effective LLM based application.

You rated this post out of 5. Change rating

2024-03-04

2,267 reads

SQLServerCentral Article

What is OneLake in Microsoft Fabric?

  • Article

Get ready to be blown away! The highly anticipated Microsoft Build in May 2023 has finally unveiled its latest and greatest creation: the incredible Microsoft Fabric - an unparalleled Data Intelligence platform that is guaranteed to revolutionize the tech world! fig 1: OneLake for all Data One of the most exciting things in Fabric I […]

4.5 (4)

You rated this post out of 5. Change rating

2023-07-26

4,365 reads

SQLServerCentral Article

Step by Step Guide to Install Jupyter Notebook

  • Article

Whether you work as a Data Engineer or a Data Scientist, a Jupyter Notebook is a helpful tool. One of the projects I was working required a comparison of two parquet files. This is mainly a schema comparison, not a data comparison. Though the two .parquet were created from two different sources, the outcome should […]

You rated this post out of 5. Change rating

2021-05-17

4,935 reads

SQLServerCentral Article

Dynamically Add a Timestamp To Files in Azure Data Factory

  • Article

This article will describe how to add your local timestamp at the end of the each file in Azure Data Factory (ADF). In general, ADF gets a UTC timestamp, so we need to convert the timestamp from UTC to EST, since our local time zone is EST. For example, if the input Source file name […]

5 (2)

You rated this post out of 5. Change rating

2021-04-22

26,972 reads

SQLServerCentral Article

Google Cloud Certification for Microsoft Database Engineer

  • Article

Introduction I recently passed the Google Cloud Professional Data Engineer certification exam, Professional Data Engineer Certification. It took me about five month to prepare for this, and I would like to share my thoughts of why I decided to take it on and how I prepared for it. At the moment, Google cloud (GCP) is […]

5 (7)

You rated this post out of 5. Change rating

2021-03-15

9,547 reads

Blogs

Announcements from the Microsoft Fabric Community Conference

By

(Shameless plug: The price of my book “Deciphering Data Architectures: Choosing Between a Modern...

The Basics of TRY CATCH Blocks–#SQLNewBlogger

By

I was working with a customer and discussing how to do error handling. This...

Working with ALS – Insights from the Ability Summit

By

The 14th annual Ability Summit is a global event that I attended a few...

Read the latest Blogs

Forums

Basic SQL Query question

By jjevans

Hello, I was given this SQL question and was hoping someone could please help...

Different logical drives in 2024?

By kevin.j.sexton

In recent days past, there was a Performance gain by placing data files, log...

Using data returned from sql

By kelly.fergus@gmail.com

Ok, I've come up with another problem in my project. I am happily pulling...

Visit the forum

Question of the Day

Backing up the Resource Database

How does the Resource database in SQL Server 2022 get backed up?

See possible answers