Tim Mitchell is a business intelligence consultant, author, trainer, and SQL Server MVP with over a decade of data management experience. He is a partner with Linchpin People and is the principal of Tyleris Data Solutions.
Tim has spoken at international and local events including the SQL PASS Summit, SQLBits, SQL Connections, along with dozens of tech fests, code camps, and SQL Saturday events. He is coauthor of the book SSIS Design Patterns, and is a contributing author on MVP Deep Dives 2.
It’s election season! No, I’m not talking about The Donald, The Clinton, The Neurosurgeon, The Veep, or any of those folks. It’s time for the annual SQL PASS board elections.
For data warehouse professionals, change detection is critical. Accurately detecting new, changed, and deleted records means the difference between doing an expensive truncate-and-reload operation versus a smaller, faster incremental load. This is especially important as the volume of information stored in data warehouses continues to grow. SQL Server change tracking,… Read more
I’m happy to announce a new, full-day class in the Dallas area next month. I’ll be presenting my Building Better SSIS Packages course on Friday, October 2nd at the Microsoft campus in Irving, Texas. This course is a preconference seminar for SQL Saturday Dallas, which will be held in… Read more
In just two short months – exactly sixty days from today – the SQL PASS Summit will begin. Although it’s still a couple of months away, this is a great time to start making preparations to ensure that you get the most out of your Summit experience.
Download and install… Read more
What is permissible is not always honorable. – Marcus Tullius Cicero
Rules. Best practices. Guidelines. Design patterns. Policies. All are good and necessary, and you’ll rarely find anyone who will argue against the need to establish boundaries and set expectations. But can adherence to rules and design patterns be taken… Read more
As data professionals, there are times when our jobs are relatively easy. Back up the databases. Create the dashboard report. Move the data from flat files to the database. Create documentation. There are lots of cogs… Read more
If you’ve used SSIS for any significant amount of time, you’ve almost certainly run into this roadblock: You need to download a file stored on an SFTP (secure FTP) server, but SSIS does not natively support this operation. There is a built-in FTP task in SSIS, but it is very… Read more
Without a doubt, the most versatile data flow tool in the SSIS arsenal is the script component. This control grants ETL developers complete control over the flow of data, leverages the full power of the .NET Framework namespaces, and can be used as a source, destination, or transformation in data… Read more
Earlier this week, I confirmed two full-day seminars I’ll be delivering in conjunction with SQL Saturday events this fall. I’ve got a brand new course entitled “Building Better SSIS Packages” which I’ll be delivering in Denver and Boston. Here’s a brief into to this course:
SQL Server Integration Services… Read more
How do you know that you’ve asked enough questions? When you think you have all the information you need to get started, ask 10 more good questions. Those ten questions will lead to five more, which will lead to… Read more
I’m a fixer. A tinkerer. As a kid, I would take my toys apart just to see how they worked, and to prove that I could put them back together again (and these experiments often had mixed results). Even today, I’m still kind of a shade tree handyman. In fact,… Read more
During data load or transformation processes, capturing a distinct row number for incoming data can be beneficial for the ETL process itself, as well as for use in the destination database. Having an arbitrary, incrementing row number assigned to each row can help to determine the order in which the… Read more
Now that the details have been finalized, I can announce that a new SSIS class coming up this fall. My Linchpin People cohort Andy Leonard and I will be delivering our Advanced SSIS training class in the Washington, DC area in December. This class is four days in length, ideally… Read more
Temporary Post Used For Theme Detection (d2df4373-a605-4b61-86ee-a1afe06d7e22 – 3bfe001a-32de-4114-a6b4-4005b770f6d7)
This is a temporary post that was not deleted. Please delete this manually. (af8cc091-a628-437f-8918-348486ad1d80 – 3bfe001a-32de-4114-a6b4-4005b770f6d7)
Through the course of my 8-someodd years of building and fixing ETL processes, I’ve had the opportunity to see a lot of ETL code. Some of that code was really good, well-thought-out and carefully executed. Other load processes were – well, let’s just say that they provide plenty of consulting… Read more
If you’ve read my blog or attended one of my presentations before, you almost certainly know that I’m a huge fan of Biml. If you’re building or maintaining SSIS packages (or you’re supervising those that do), you owe it to yourself to learn about Biml. I don’t make a lot… Read more
If you’re reading this, we have done business together, either directly or indirectly. You might be a retail website from which I purchase products or services. You could be a social media empire on which I share blog posts, life events, and… Read more
In my most recent post in this series, I talked about how to use the SSIS object variable as an ADO recordset as a source in a data flow. By loading the result set of a query into this variable, the contents of the variable can be read by an… Read more
Everybody wants to be liked, to some extent. Being disliked by others feels like a deficiency, a shortcoming in oneself that must be fixed. It feels like a failure that you’ve let someone down, or even worse, it can make you feel like you’re somehow broken or deficient.
I would… Read more
Object variables in SSIS are incredibly versatile, allowing the storage of almost any type of data (even .NET objects). In my last post on this topic, I demonstrated how an SSIS object variable containing a .NET DataSet object could be used by the for each loop container as an… Read more