Engineering a Lakehouse with Azure Databricks with Spark Dataframes
How can we get familiar with Azure Databricks with Spark Dataframes?
2025-02-26
Apache Spark
Learning Spark SQL String Functions with Explanations and Code Examples
Learn how to use different Spark SQL string functions to manipulate string data with explanations and code examples.
2024-04-29
Managing Files and Folders with Python – Data Engineering with Fabric
In this article, learn how you can manage files and folders for both full and incremental loading situations.
2024-03-27
3,661 reads
Managed Vs Unmanaged Tables – Data Engineering with Fabric
Learn how to get started with Microsoft Fabric along with the differences between managed and unmanaged tables.
2024-03-20
4,638 reads
Using Spark Jobs for Multiple Lakehouse Maintenance in Microsoft Fabric
I have published videos and articles before about Lakehouse maintenance. In this article I want to address a missing point for a lot of Fabric administrators: How to do maintenance on multiple lakehouses that are located in different workspaces.
2024-01-03
Learn Spark SQL Date and Time Functions
This article covers how to use the different date and time functions when working with Spark SQL.
2023-12-08
Exploring Hive Tables with Spark SQL
In this article, we will look at how to use an Azure Databricks Workspace to explore Hive tables using Spark SQL along with several examples.
2022-12-12
Improving Performance In Spark Using Partitions
In this blog post we are going to show how to optimize your Spark job by partitioning the data correctly. To demonstrate this we are going to use the College Score Card public dataset, which has several key data points from colleges all around the United States. We will compute the average student fees by state with this dataset.
2019-04-12
Ingesting Data From Files With Apache Spark, Part 1
In this post, a data expert teaches us how to take in large data sets using Apache Spark.
2019-04-12
Blogs
Tech Conferences and Expanding Your View
By Brian Kelley
Tech conferences aren't just for networking and learning how to address a problem you're...
Managing subscribers, creating newsletters
By DataOnWheels
When I created the website on WordPress, I was expecting all the features I...
Finding the Last Last Name in SQL: #SQLNewBlogger
By Steve Jones
I wrote a piece on the new SUBSTRING in SQL Server 2025 and got...
Forums
Email change does not work
I changed my email address in Edit Profile page, but it has no effect...
The case for "Understanding our business" training
Comments posted to this topic are about the item The case for "Understanding our...
Specifying the Collation
Comments posted to this topic are about the item Specifying the Collation
Question of the Day
Specifying the Collation
I am dealing with issues on my SQL Server 2022 instance related to collation. I have an instance collation of Latin1_General_CS_AS_KS_WS, but a database collation of Latin1_General_CI_AS. I want to force a few queries to run with a specified collation by using code like this:
DECLARE @c VARCHAR(20) = 'Latin1_General_CI_AS'
SELECT p.PersonType,
p.Title,
p.LastName,
c.CustomerID,
c.AccountNumber
FROM Person.Person AS p
INNER JOIN Sales.Customer AS c
ON c.PersonID = p.BusinessEntityID
COLLATE @c
Will this solve my problem? See possible answers