Learning Spark SQL String Functions with Explanations and Code Examples
Learn how to use different Spark SQL string functions to manipulate string data with explanations and code examples.
2024-04-29
Apache Spark
Managing Files and Folders with Python – Data Engineering with Fabric
In this article, learn how you can manage files and folders for both full and incremental loading situations.
2024-03-27
2,758 reads
Managed Vs Unmanaged Tables – Data Engineering with Fabric
Learn how to get started with Microsoft Fabric along with the differences between managed and unmanaged tables.
2024-03-20
3,099 reads
Using Spark Jobs for Multiple Lakehouse Maintenance in Microsoft Fabric
I have published videos and articles before about Lakehouse maintenance. In this article I want to address a missing point for a lot of Fabric administrators: How to do maintenance on multiple lakehouses that are located in different workspaces.
2024-01-03
Learn Spark SQL Date and Time Functions
This article covers how to use the different date and time functions when working with Spark SQL.
2023-12-08
Exploring Hive Tables with Spark SQL
In this article, we will look at how to use an Azure Databricks Workspace to explore Hive tables using Spark SQL along with several examples.
2022-12-12
Improving Performance In Spark Using Partitions
In this blog post we are going to show how to optimize your Spark job by partitioning the data correctly. To demonstrate this we are going to use the College Score Card public dataset, which has several key data points from colleges all around the United States. We will compute the average student fees by state with this dataset.
2019-04-12
Ingesting Data From Files With Apache Spark, Part 1
In this post, a data expert teaches us how to take in large data sets using Apache Spark.
2019-04-12
Blogs
A New Word: Vicarous
By Steve Jones
vicarous – adj. curious to know what someone else would do if they were...
SQL Server Cross Platform Availability Groups and Kubernetes
Say we have a database that we want to migrate a copy of into...
Using Managed Identities with Azure SQL DB
We are trying to get apps and users off of using SQL accounts to...
Forums
View works for me ...but doesn't return results for a user in SSMS but no errors
Hi I have this view to check if a job is running: SELECT...
Dark mode, other color schemes
All, if you are like me and do not care for the built-in color...
Question of the Day
Internal Checkpoints
Certain internal SQL Server actions cause internal checkpoints. Which of these actions does not cause an internal checkpoint?
See possible answers