Whether you work as a Data Engineer or a Data Scientist, a Jupyter Notebook is a helpful tool. One of the projects I was working required a comparison of two parquet files. This is mainly a schema comparison, not a data comparison. Though the two .parquet were created from two different sources, the outcome should […]
2021-05-17
5,515 reads
This article will describe how to add your local timestamp at the end of the each file in Azure Data Factory (ADF). In general, ADF gets a UTC timestamp, so we need to convert the timestamp from UTC to EST, since our local time zone is EST. For example, if the input Source file name […]
2021-04-22
30,338 reads
Introduction I recently passed the Google Cloud Professional Data Engineer certification exam, Professional Data Engineer Certification. It took me about five month to prepare for this, and I would like to share my thoughts of why I decided to take it on and how I prepared for it. At the moment, Google cloud (GCP) is […]
2021-03-15
9,786 reads
You run EXPLAIN ANALYZE on a slow query, stare at the plan, and something...
By Steve Jones
la guadière – n. a glint of goodness you notice in something that you...
By James Serra
Microsoft Purview can be the best data governance tool in the world, but it...
hi, we couldnt get our upstream data source developers to supply what is sometimes...
Are there any good articles on all the trace flags that are enabled on...
Comments posted to this topic are about the item The Data Model Matters
I run the SQLCMD utility as follows:
lcmd -S localhost -EI then type this (the 1> is the prompt):
1> select @@version goIf I hit enter, what happens? See possible answers