For my new mission, I set out to convert a list of files from Excel to comma-separated values (CSV). We upload the original Excel files to a Data Lake in Fabric. We then need to convert a specific worksheet and move the CSV files to a different folder in Data Lake.
2024-12-25
Over the past years, the tool dbt – short for data build tool – has become quite popular in the data engineering world for handling such an ELT process. dbt takes on the role of the “T”, meaning it’s responsible for transforming the data in a certain data store.
2024-12-23
How to create a connection for StreamLit and Snowflake to upload data for visualization
2024-12-20
2,524 reads
How we handle data warehousing updates to dimension tables is crucial and this article covers Slowly Changing Dimensions versus overwriting tables.
2024-12-20
Find your personal ROI in under 1 minute. And see how many working days you and your team could save in coding time with SQL Prompt!
2024-12-20
PASS Data Community Summit will return to Seattle next year! Save the date for this incredible in-person event for global data professionals, which will take place at Summit, Seattle Convention Center, from November 17-21, 2025!
2024-12-18
I was asked recently why Halloween Protection was needed for data modification statements that include a self-join of the target table. This gives me a chance to explain, while also covering some interesting product bug history from the SQL Server 7 and 2000 days.
2024-12-18
Keeping track of all the security related logs can be hard. Using your security team to shoulder some of the load can help. Learn how in this article.
2024-12-16
3,722 reads
In this article, we look at how to use Apache Kafka and Zookeeper to process and load streaming data.
2024-12-16
Earlier this year I had a PM at Microsoft reach out and ask me what I thought about the Data API Builder. I hadn't looked at it, so I made a note to check it out. I hadn't done that by the time SQL Saturday Denver 2024 occurred, where I saw Jerry Nixon from Microsoft […]
2024-12-13
6,817 reads
By Brian Kelley
If you want to learn better, pause more in your learning to intentionally review.
By John
If you’ve used Azure SQL Managed Instance General Purpose, you know the drill: to...
By DataOnWheels
Ramblings of a retired data architect Let me start by saying that I have...
Not sure if this is really a relational theory question but it seems about...
Hi everyone, Below is a consolidated summary of what we validated Architecture & data...
Hi all, I recently moved to a new employer who have their HA setup...
I have this data in a SQL Server 2025 table:
CREATE TABLE Response ( ResponseID INT NOT NULL CONSTRAINT ResponsePK PRIMARY KEY , ResponseVal VARBINARY(5000) ) GOIf I want to get a value from this table that I can add to a URL in a browser, which of these code items produces a result I can use? See possible answers