Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 

SQLRunner

This blog is syndicated from SSIS - SQL Server Tidbits(http://www.josefrichberg.com/)

SSIS OLEDB Command and procedure output params

While designing a package last week with our consultant, Latha Chandri (twitter), I came across a need to call a stored procedure drom within a Data Flow Task.  I have never needed to do this before and while the call is simple there are a few quirks… Read more

0 comments, 4,546 reads

Posted in SQLRunner on 30 June 2011

Statistics IO parser in Ruby & Python

Here I am working on tuning a rather large stored procedure; old school.  I have statistics IO and showplan turned on.  I work through the obvious missing indexes and improper joins and now I'm into the 'Let's try this technique', to improve different pieces.  The gauge for me… Read more

0 comments, 329 reads

Posted in SQLRunner on 10 June 2011

Improved partition loading

We have a table that contains just over 1.7 billion records and requires a daily feeding of around 9 million.  It is split into 10, roughly equal, partitions.  I originally just pushed the daily feeding into the main table from a staging table and it worked well, but thought to… Read more

1 comments, 262 reads

Posted in SQLRunner on 6 June 2011

SQL Lunch #48 Advanced SSIS Tips & Tricks

I had the privilege of giving a SQL Lunch presentation today.  The slide deck for that can be found here: SSIS Tips & Tricks deck.  The recording can be downloaded at SQLLunch.  I am not sure when it will be available, but when it is I'll see about… Read more

0 comments, 914 reads

Posted in SQLRunner on 30 January 2011

Shout out to SQLPeople.Net

I wanted simply give a shout out to Andy Leonard (twitter | blog) for his never ending commitment to the SQL Community.  Take a look at SQLPeople.net and join the community. Read more

0 comments, 554 reads

Posted in SQLRunner on 29 January 2011

Behold, SSIS Advanced Editor for Data Source Components

It's not everyday that one of your information vendors decides to change the format of its data feed.  Evidently, today is not every day.  It would be one thing to change the data type of an incoming field or even add/remove a field from the feed.  Nope, they decided to… Read more

0 comments, 320 reads

Posted in SQLRunner on 16 December 2010

SSIS : Using variables as a source in a Data Flow Component

Currently, none of the existing Data Flow sources allow you to source variables.  Once again in my quest for performance, I look to keep as much data as possible in memory.  There are many uses for pushing data to external files (Raw Files, control files, etc), but there is a… Read more

0 comments, 455 reads

Posted in SQLRunner on 12 November 2010

SSIS: Using a Script Component as a substitute OLEDB Destination

I developed an SSIS package that loads invoices, statements, pro-formas, etc. into a SQL Server table.  The invoices are .pdf files and the business required that no identical documents were allowed to be stored.  To determine uniqueness I simply created a hash of each document and used it as the… Read more

0 comments, 237 reads

Posted in SQLRunner on 5 November 2010

A local SSIS queue in C#; because the muffins are that good.

Since I designed the Enhanced Threading Framework (ETF) I am always looking to improve it.  Status quo is not for me.  I decided to take on the 'queue' part of the framework.  This is the part that uses a SQL Server table to manage the list of work to be… Read more

0 comments, 323 reads

Posted in SQLRunner on 17 July 2010

Tinkering with a local queue

I've been toying with the idea of using a file as a queue instead of a database table for use with my Enhanced Threading Framework.  This has been challenging and I am nearly complete.  I can't say at this time if it is faster or slower, better or worse, a… Read more

0 comments, 215 reads

Posted in SQLRunner on 6 July 2010

Importing binary files with SSIS

I have gotten a number of emails over the past few days asking about how I import binary files into SSIS as well as how to improve throughput by making tasks parallel.  I have, scattered throughout this blog, articles which show bits and pieces.  I have articles on how…

Read more

0 comments, 944 reads

Posted in SQLRunner on 28 May 2010

Evernote and the posting of scripts.

I heard of EverNote sporadically in the Twitter community and from my boss.  I had checked it out and it seemed like another place to store notes/tips/ideas.  I thought to myself 'What could I possibly use this for?"  I've read some articles where a restaurant chef uses this to… Read more

0 comments, 274 reads

Posted in SQLRunner on 23 May 2010

SSIS : Data Flow paths

I had a very interesting bug that had me running around for over a week.  Turns out the bug was in my code due to a misunderstanding of how SSIS processes the  Data Flow Task.   I've found in that time that SSIS not only evaluates, but actually 'runs' code… Read more

0 comments, 309 reads

Posted in SQLRunner on 1 May 2010

SSIS : Using the VariableDispenser object within Script Components

 I have become accustom to modifying package variables within my Script Task using the VariablesDispenser  object.  It is convenient and powerful.  I started working with this object due to issues I found while hacking my way through SSIS2005.  I would put the variables in the ReadOnly…

Read more

0 comments, 597 reads

Posted in SQLRunner on 26 April 2010

SSIS : Using the VariableDispenser object within Script Components

 I have become accustom to modifying package variables within my Script Task using the VariablesDispenser  object.  It is convenient and powerful.  I started working with this object due to issues I found while hacking my way through SSIS2005.  I would put the variables in the ReadOnly…

Read more

2 comments, 1,240 reads

Posted in SQLRunner on 26 April 2010

SSIS : Conditional Split optimization

I have built an enormous number of packages for this project over the past few weeks (just over 60) and wondered if a conditional split case without a destination was efficient.  I have been using the Conditional Split component with one case going nowhere as a way to 'throw' out… Read more

0 comments, 230 reads

Posted in SQLRunner on 26 April 2010

Indexed Views

Views are used quite often within SQL Server for a number of reasons.  They can be used to restrict access to tables (restrict the columns viewable or the records returned) , combine multiple tables into a single 'virtual table', or apply specific sets of formulas(like avg cost or an item).… Read more

0 comments, 174 reads

Posted in SQLRunner on 26 March 2010

Simple Series : SSIS Conditional Split

Conditional Split is a very powerful component, enabling you to send records in different directions or exclude them from the downstream altogether.  I use this component quite often in my SSIS packages.  In the industry I work in, publishing, there are many times we'll get a file in from…

Read more

0 comments, 423 reads

Posted in SQLRunner on 26 March 2010

Simple Series : SSIS Conditional Split

Conditional Split is a very powerful component, enabling you to send records in different directions or exclude them from the downstream altogether.  I use this component quite often in my SSIS packages.  In the industry I work in, publishing, there are many times we'll get a file in from…

Read more

1 comments, 497 reads

Posted in SQLRunner on 25 March 2010

Virtual Presentation : Index Statistics

I just gave a virtual presentation, courtesy of Pass and the appdev group.  The recorded presentation is available here:

Recorded Presentation

 

A copy of the slide deck is available in the download section:

Index Statistics

 

  Read more

0 comments, 226 reads

Posted in SQLRunner on 23 March 2010

Newer posts

Older posts