Tim Mitchell is a business intelligence consultant, author, trainer, and Microsoft Data Platform MVP with over thirteen years of data management experience. He is the founder and principal of Tyleris Data Solutions.
Tim has spoken at international and local events including the SQL PASS Summit, SQLBits, SQL Connections, along with dozens of tech fests, code camps, and SQL Saturday events. He is coauthor of the book SSIS Design Patterns, and is a contributing author on MVP Deep Dives 2.
Bad data can kill. Literally. I’m not talking about the impact of bad data on the bottom line of business, where estimates of total losses are usually gauged in the hundreds of billions of dollars per year. Nor am I talking about the inconvenience we all face when presented with… Read more
Before I began my technical career over a decade and a half ago, I spent several years working in law enforcement. In that field, one of the things one must learn quickly is the concept of the chain of custody of evidence. There were numerous procedures we had to follow… Read more
If you are looking for affordable, high-quality training on SQL Server Integration Services, you may be interested in one of the two full-day workshops I have scheduled for August of this year. I’ll be taking my popular course Building Better SSIS Packages on the road to Baton Rouge, Louisiana and… Read more
Three years ago, I left the ranks of full-time employment to become an independent consultant. At the same time, I partnered with Linchpin People, a guild of independent consultants made up of some of the very best practitioners in the database and business intelligence space. Working with Linchpin helped to… Read more
It happens far too often: Once an ETL process has been tested and executes successfully, there are no further checks to ensure that the operation actually did what it was supposed to do. Sometimes it takes a day, other times it takes a year, but eventually that call comes from… Read more
If you were to poll data professionals on which tasks they enjoy working on the most, ETL logging would probably not make the list. However, it is essential to the success of any ETL architecture to establish an appropriate logging strategy. I like to compare a good logging infrastructure to… Read more
A few weeks ago I met a couple of my business partners in a moderately upscale restaurant in the Washington, DC area. It was not my typical kind of place – I’m more of a casual dining guy – but I did enjoy the experience and the atmosphere. There wasn’t… Read more
For data warehouse professionals, data change detection is is a central part of what we do. Accurately detecting new, changed, and deleted records means the difference between doing an expensive truncate-and-reload operation versus a smaller, faster incremental load. SQL Server change tracking, a feature first introduced in SQL Server 2008,… Read more
File-based ETL is usually dull. Most systems generate (or expect to consume) files that are delimited, with a common field separator such as comma, tab, or pipe. However, occasionally you’ll get an oddly formatted file with an unusual delimiter. Although it’s not obvious in the Visual Studio designer, SSIS is… Read more
Recently, I wrote about how to get started with SQL Server change tracking, and I demonstrated a design pattern I use with change tracking in incremental load scenarios. In this post, I’ll round out the topic by showing how using change tracking in SSIS packages can add more flexibility to… Read more
Earlier this week I wrote about the basics of change tracking in SQL Server, and showed how to get started using this technology for change detection. In this post, I’ll continue what I started by demonstrating how change tracking fits into a larger design pattern for end-to-end incremental load ETL… Read more
Change tracking for SQL Server is a flexible and easy-to-use technology for monitoring tables for inserts, updates, and deletes. In this post, I’ll discuss getting started with change tracking in SQL Server, and will show an example of how to get started with it. Change Tracking Overview Change tracking is… Read more
For several months I’ve been eyeing a replacement for my aging Surface Pro 2. Although I’ve been pretty happy with this tablet PC, it’s got a few limitations – most notably, it doesn’t have enough horsepower to run most of my demos. Because I do a lot of travel and… Read more
Humans are creatures of habit, and I suspect that engineering/technical types are even more so. We find something that works and tend to stick with it, sometimes neglecting to occasionally experiment with new tools or methods. The mantra of “If it ain’t broke, don’t fix it” becomes the defense for… Read more
Over the Thanksgiving holiday, I read a book entitled The Phoenix Project. This book has been in my Kindle library for some time, but only this weekend did I make time to read it – and I’m glad I did. The story centers around a guy who is more or… Read more
Today is the second day of the SQL PASS Summit in Seattle, Washington. I’ll be live blogging today’s keynote address. This post will be updated throughout the keynote. Don’t forget you can watch the live stream on PASS TV. Adam Jorgensen, current EVP of finance (and future president) of PASS… Read more
Today, I’ll be live blogging the SQL PASS 2015 keynote. Today is the third day of the PASS Summit, and the first day with regular sessions. Everything shown in the keynote will also be streamed on PASS TV. As a logistical note, I’ll be updating this post throughout the keynote.… Read more
Last week I hosted a webinar in which I reviewed some of the coming changes for SQL Server Integration Services in SQL Server 2016. The current beta of SSIS 2016 has some exciting new features that I think you’ll like. The recording of that webinar is below. Enjoy!
The post… Read more
If you are looking for some end-of-year training before the new budget year rolls around, consider joining Andy Leonard and me in the Washington, DC area for our 4-day Advanced SSIS classroom training course. This course will be held December 7-10 in Reston, VA (just outside of DC). I’ve… Read more
The next version of SSIS is on the horizon. Are you ready?
In next Tuesday’s webinar, I’ll be reviewing and demonstrating the new features of SQL Server Integration Services. Microsoft recently released the CTP bits for SQL Server and SQL Server Data Tools, both of which show several useful… Read more