Tim Mitchell is a business intelligence consultant, author, trainer, and SQL Server MVP with over a decade of data management experience. He is a partner with Linchpin People and is the principal of Tyleris Data Solutions.
Tim has spoken at international and local events including the SQL PASS Summit, SQLBits, SQL Connections, along with dozens of tech fests, code camps, and SQL Saturday events. He is coauthor of the book SSIS Design Patterns, and is a contributing author on MVP Deep Dives 2.
It happens far too often: Once an ETL process has been tested and executes successfully, there are no further checks to ensure that the operation actually did what it was supposed to do. Sometimes it takes a day, other times it takes a year, but eventually that call comes from… Read more
If you were to poll data professionals on which tasks they enjoy working on the most, ETL logging would probably not make the list. However, it is essential to the success of any ETL architecture to establish an appropriate logging strategy. I like to compare a good logging infrastructure to… Read more
A few weeks ago I met a couple of my business partners in a moderately upscale restaurant in the Washington, DC area. It was not my typical kind of place – I’m more of a casual dining guy – but I did enjoy the experience and the atmosphere. There wasn’t… Read more
For data warehouse professionals, data change detection is is a central part of what we do. Accurately detecting new, changed, and deleted records means the difference between doing an expensive truncate-and-reload operation versus a smaller, faster incremental load. SQL Server change tracking, a feature first introduced in SQL Server 2008,… Read more
File-based ETL is usually dull. Most systems generate (or expect to consume) files that are delimited, with a common field separator such as comma, tab, or pipe. However, occasionally you’ll get an oddly formatted file with an unusual delimiter. Although it’s not obvious in the Visual Studio designer, SSIS is… Read more
Recently, I wrote about how to get started with SQL Server change tracking, and I demonstrated a design pattern I use with change tracking in incremental load scenarios. In this post, I’ll round out the topic by showing how using change tracking in SSIS packages can add more flexibility to… Read more
Earlier this week I wrote about the basics of change tracking in SQL Server, and showed how to get started using this technology for change detection. In this post, I’ll continue what I started by demonstrating how change tracking fits into a larger design pattern for end-to-end incremental load ETL… Read more
Change tracking for SQL Server is a flexible and easy-to-use technology for monitoring tables for inserts, updates, and deletes. In this post, I’ll discuss getting started with change tracking in SQL Server, and will show an example of how to get started with it. Change Tracking Overview Change tracking is… Read more
For several months I’ve been eyeing a replacement for my aging Surface Pro 2. Although I’ve been pretty happy with this tablet PC, it’s got a few limitations – most notably, it doesn’t have enough horsepower to run most of my demos. Because I do a lot of travel and… Read more
Humans are creatures of habit, and I suspect that engineering/technical types are even more so. We find something that works and tend to stick with it, sometimes neglecting to occasionally experiment with new tools or methods. The mantra of “If it ain’t broke, don’t fix it” becomes the defense for… Read more
Over the Thanksgiving holiday, I read a book entitled The Phoenix Project. This book has been in my Kindle library for some time, but only this weekend did I make time to read it – and I’m glad I did. The story centers around a guy who is more or… Read more
Today is the second day of the SQL PASS Summit in Seattle, Washington. I’ll be live blogging today’s keynote address. This post will be updated throughout the keynote. Don’t forget you can watch the live stream on PASS TV. Adam Jorgensen, current EVP of finance (and future president) of PASS… Read more
Today, I’ll be live blogging the SQL PASS 2015 keynote. Today is the third day of the PASS Summit, and the first day with regular sessions. Everything shown in the keynote will also be streamed on PASS TV. As a logistical note, I’ll be updating this post throughout the keynote.… Read more
Last week I hosted a webinar in which I reviewed some of the coming changes for SQL Server Integration Services in SQL Server 2016. The current beta of SSIS 2016 has some exciting new features that I think you’ll like. The recording of that webinar is below. Enjoy!
The post… Read more
If you are looking for some end-of-year training before the new budget year rolls around, consider joining Andy Leonard and me in the Washington, DC area for our 4-day Advanced SSIS classroom training course. This course will be held December 7-10 in Reston, VA (just outside of DC). I’ve… Read more
The next version of SSIS is on the horizon. Are you ready?
In next Tuesday’s webinar, I’ll be reviewing and demonstrating the new features of SQL Server Integration Services. Microsoft recently released the CTP bits for SQL Server and SQL Server Data Tools, both of which show several useful… Read more
It’s election season! No, I’m not talking about The Donald, The Clinton, The Neurosurgeon, The Veep, or any of those folks. It’s time for the annual SQL PASS board elections.
For data warehouse professionals, change detection is critical. Accurately detecting new, changed, and deleted records means the difference between doing an expensive truncate-and-reload operation versus a smaller, faster incremental load. This is especially important as the volume of information stored in data warehouses continues to grow. SQL Server change tracking,… Read more
I’m happy to announce a new, full-day class in the Dallas area next month. I’ll be presenting my Building Better SSIS Packages course on Friday, October 2nd at the Microsoft campus in Irving, Texas. This course is a preconference seminar for SQL Saturday Dallas, which will be held in… Read more
In just two short months – exactly sixty days from today – the SQL PASS Summit will begin. Although it’s still a couple of months away, this is a great time to start making preparations to ensure that you get the most out of your Summit experience.
Download and install… Read more