<a href="http://g.adspeed.net/ad.php?do=clk&zid=15220&wd=468&ht=60&pair=as" target="_blank"><img style="border:0px;" src="http://g.adspeed.net/ad.php?do=img&zid=15220&wd=468&ht=60&pair=as" alt="i" width="468" height="60"/></a>
Log in
::
Register
::
Not logged in
Home
Tags
Articles
Editorials
Stairways
Forums
Scripts
Videos
Blogs
QotD
Books
Ask SSC
SQL Jobs
Training
Authors
About us
Contact us
Newsletters
Write for us
<a href="http://g.adspeed.net/ad.php?do=clk&zid=15491&wd=120&ht=300&pair=as" target="_top"><img style="border:0px;" src="http://g.adspeed.net/ad.php?do=img&zid=15491&wd=120&ht=300&pair=as" alt="i" width="120" height="300"/></a>
Recent Posts
Recent Posts
Popular Topics
Popular Topics
Home
Search
Members
Calendar
Who's On
Home
»
Article Discussions
»
Article Discussions by Author
»
Discuss Content Posted by Andy Leonard
»
SSIS 101: Isolating Data in a Data Flow
SSIS 101: Isolating Data in a Data Flow
Rate Topic
Display Mode
Topic Options
Author
Message
Andy Leonard
Andy Leonard
Posted Wednesday, February 11, 2009 12:16 AM
Old Hand
Group: General Forum Members
Last Login: Monday, May 13, 2013 2:53 PM
Points: 375,
Visits: 947
Comments posted to this topic are about the item
SSIS 101: Isolating Data in a Data Flow
Andy Leonard
CSO, Linchpin People
Follow me on Twitter:
@AndyLeonard
Post #654486
Manie Verster
Manie Verster
Posted Wednesday, February 11, 2009 6:05 AM
Ten Centuries
Group: General Forum Members
Last Login: Monday, May 20, 2013 3:00 AM
Points: 1,151,
Visits: 879
Hi Andy,
Nice article but afraid I lost you along the way. You know, where you started with the Union All's and the rest, I still have the red error mark on my ContactStage but don't see where you handled that part. Excuse me if I am silly or stupid but can you help me out here please. I am busy training myself in SSIS and your aticle came on the right time.
Manie Verster
Developer
Johannesburg
South Africa
Life is about choices.... I choose to be happy today
Post #654705
Jack Corbett
Jack Corbett
Posted Wednesday, February 11, 2009 6:32 AM
SSChampion
Group: General Forum Members
Last Login: Friday, May 17, 2013 12:22 PM
Points: 10,571,
Visits: 11,871
Nice article Andy. I've never used the multicast task and didn't have an idea why I'd use it, but this is a good way use for it in my situation. I've always edited my source query with a where clause to check out problematic or specific rows.
This is another tool in the toolbox. Thanks.
Jack Corbett
Applications Developer
Don't let the good be the enemy of the best. --
Paul Fleming
Check out these links on how to get faster and more accurate answers:
Forum Etiquette: How to post data/code on a forum to get the best help
Need an Answer? Actually, No ... You Need a Question
How to Post Performance Problems
Crosstabs and Pivots or How to turn rows into columns Part 1
Crosstabs and Pivots or How to turn rows into columns Part 2
Post #654731
KEVIN.L.STEVENS
KEVIN.L.STEVENS
Posted Wednesday, February 11, 2009 7:53 AM
Forum Newbie
Group: General Forum Members
Last Login: Thursday, December 30, 2010 9:54 AM
Points: 4,
Visits: 9
Here is where Andy tells how to correct the target information:
This scenario occurs with enough frequency to justify the Restore Invalid Column References Editor, shown above. The ContactID column with Lineage ID 32 is shown as invalid, but the References Editor located (and suggests) a column with the same name and data type: the ContactID column with Lineage ID 333. In fact, it’s located new columns for all the invalid references (although the error did not report these additional columns).
Click OK to replace the invalid references with the suggested columns
You have several options in the Restore Invalid Column References Editor. One of them is to let the editor try to restore the invalid links but I usually highlight all of the rows listed and click on the delete invalid rows option and hit "Apply" (there is no OK button). This will close the editor and remove the invalid references. When you reopen the target again everything should fix itself and you are on your way.
Post #654838
DCPeterson
DCPeterson
Posted Wednesday, February 11, 2009 8:52 AM
Ten Centuries
Group: General Forum Members
Last Login: Tuesday, May 21, 2013 8:38 AM
Points: 1,032,
Visits: 390
Nice article Andy, I never really understood what the data viewers were. I sure wish I'd had this information a year ago...
/*****************
If most people are not willing to see the difficulty, this is mainly because, consciously or unconsciously, they assume that it will be they who will settle these questions for the others, and because they are convinced of their own capacity to do this. -Friedrich August von Hayek
*****************/
Post #654934
Derek Dongray
Derek Dongray
Posted Wednesday, February 11, 2009 9:02 AM
Ten Centuries
Group: General Forum Members
Last Login: Monday, May 13, 2013 2:04 AM
Points: 1,342,
Visits: 1,946
Great article. I too am having to do more and more work with SSIS and, naturally, don't have time/budget to go on training
hence learning about the tools described here is very helpful.
Thanks.
Derek
Post #654949
bc_
bc_
Posted Wednesday, February 11, 2009 9:49 AM
Ten Centuries
Group: General Forum Members
Last Login: 2 days ago @ 12:52 PM
Points: 1,304,
Visits: 7,121
I like the Data Probe idea. That will come in handy for sure.
Thanks,
Burke
bc
Post #655023
mcloney
mcloney
Posted Wednesday, February 11, 2009 10:01 AM
SSC Veteran
Group: General Forum Members
Last Login: Wednesday, January 23, 2013 11:08 AM
Points: 223,
Visits: 82
Hi Andy,
Great intro article on SSIS! I've been working with it for over two years, but had never tried anything similar to your "data probe" technique. It makes perfect sense.
One thing I saw in this article that's a little different is the Multicast as sort of a dummy endpoint. I've often seen a Rowcount as a dummy endpoint but never a multicast. Does the endpoint actually do anything in either case in this type of scenario?
Cheers,
-Matthew
Post #655036
Jack Corbett
Jack Corbett
Posted Wednesday, February 11, 2009 10:14 AM
SSChampion
Group: General Forum Members
Last Login: Friday, May 17, 2013 12:22 PM
Points: 10,571,
Visits: 11,871
mcloney (2/11/2009)
Hi Andy,
Great intro article on SSIS! I've been working with it for over two years, but had never tried anything similar to your "data probe" technique. It makes perfect sense.
One thing I saw in this article that's a little different is the Multicast as sort of a dummy endpoint. I've often seen a Rowcount as a dummy endpoint but never a multicast. Does the endpoint actually do anything in either case in this type of scenario?
Cheers,
-Matthew
I actually use the
konesans trash destination
when I need a dummy end point.
Jack Corbett
Applications Developer
Don't let the good be the enemy of the best. --
Paul Fleming
Check out these links on how to get faster and more accurate answers:
Forum Etiquette: How to post data/code on a forum to get the best help
Need an Answer? Actually, No ... You Need a Question
How to Post Performance Problems
Crosstabs and Pivots or How to turn rows into columns Part 1
Crosstabs and Pivots or How to turn rows into columns Part 2
Post #655052
Andy Leonard
Andy Leonard
Posted Wednesday, February 11, 2009 7:39 PM
Old Hand
Group: General Forum Members
Last Login: Monday, May 13, 2013 2:53 PM
Points: 375,
Visits: 947
Thanks for all the comments!
Matthew - Like Jack, I usually use the Konesans Trash Destination for an endpoint as well. I didn't mention it here. I also use the Script Component and the Derived Column transformations as dummy endpoints for data flow paths - basically anything that will succeed without configuration will do.
:{> Andy
Andy Leonard
CSO, Linchpin People
Follow me on Twitter:
@AndyLeonard
Post #655354
« Prev Topic
|
Next Topic »
Permissions
You
cannot
post new topics.
You
cannot
post topic replies.
You
cannot
post new polls.
You
cannot
post replies to polls.
You
cannot
edit your own topics.
You
cannot
delete your own topics.
You
cannot
edit other topics.
You
cannot
delete other topics.
You
cannot
edit your own posts.
You
cannot
edit other posts.
You
cannot
delete your own posts.
You
cannot
delete other posts.
You
cannot
post events.
You
cannot
edit your own events.
You
cannot
edit other events.
You
cannot
delete your own events.
You
cannot
delete other events.
You
cannot
send private messages.
You
cannot
send emails.
You
may
read topics.
You
cannot
rate topics.
You
cannot
vote within polls.
You
cannot
upload attachments.
You
may
download attachments.
You
cannot
post HTML code.
You
cannot
edit HTML code.
You
cannot
post IFCode.
You
cannot
post JavaScript.
You
cannot
post EmotIcons.
You
cannot
post or upload images.
Copyright © 2002-2013 Simple Talk Publishing. All Rights Reserved.
Privacy Policy.
Terms of Use.
Report Abuse.
