My only comment is that the article would be very helpful...if I fully understood what he did. I understand the basics of what he did, but many of the details fell through the cracks. More elaboration on the specifics would help us newbie/average ETL guys.

For example:

step 3...how do you make the format files from the table schema?

step 5...how do you know which records failed? Where are the failed records?

Overall, VERY interesting and impressive...just not enough details (for me anyhow)