Log in
::
Register
::
Not logged in
Home
Tags
Articles
Editorials
Stairways
Forums
Scripts
Videos
Blogs
QotD
Books
Ask SSC
SQL Jobs
Training
Authors
About us
Contact us
Newsletters
Write for us
Recent Posts
Recent Posts
Popular Topics
Popular Topics
Home
Search
Members
Calendar
Who's On
Home
»
SQL Server 2005
»
Business Intelligence
»
Access tasks in Data Flow Task dynamically
Access tasks in Data Flow Task dynamically
Rate Topic
Display Mode
Topic Options
Author
Message
revathiganesh55
revathiganesh55
Posted Thursday, November 15, 2012 10:10 PM
Forum Newbie
Group: General Forum Members
Last Login: 2 days ago @ 6:02 AM
Points: 3,
Visits: 149
Hi friends,
I have a package where the number of columns in DB tables could be changed. I want to change the meta data of data flow task dynamically. Also the mapping details will be in a seperate table as the source and destination column names need not be same.
I am able to show the newly added columns in the package but I am not able to map the columns in Data Flow Task.
Could anyone please help me on the same.
Thanks and Regards,
Reva
Post #1385464
Koen Verbeeck
Koen Verbeeck
Posted Friday, November 16, 2012 12:22 AM
SSCrazy Eights
Group: General Forum Members
Last Login: Yesterday @ 6:54 AM
Points: 9,364,
Visits: 6,462
Out of the box, SSIS doesn't support changing metadata.
There are some 3rd party products, such as Dataflow+ of CozyRoc that can do this.
If you need to stay with native SSIS, then you'll need to resort to scripting.
How to post forum questions.
Need an answer? No, you need a question.
What’s the deal with Excel & SSIS?
Member of
LinkedIn
. My blog at
LessThanDot
.
MCSA SQL Server 2012 - MCSE Business Intelligence
Post #1385500
revathiganesh55
revathiganesh55
Posted Friday, November 16, 2012 1:25 AM
Forum Newbie
Group: General Forum Members
Last Login: 2 days ago @ 6:02 AM
Points: 3,
Visits: 149
Thanks for the reply.
But can't we do the column mapping in C# and use Pipeline dlls?
Post #1385528
Koen Verbeeck
Koen Verbeeck
Posted Friday, November 16, 2012 1:28 AM
SSCrazy Eights
Group: General Forum Members
Last Login: Yesterday @ 6:54 AM
Points: 9,364,
Visits: 6,462
That's a bit out of my comfort zone.
I know that some people regenerate the package dynamically every time, so that when it runs the dataflow is mapped as it should be.
But modify an existing package on the fly? I don't know.
How to post forum questions.
Need an answer? No, you need a question.
What’s the deal with Excel & SSIS?
Member of
LinkedIn
. My blog at
LessThanDot
.
MCSA SQL Server 2012 - MCSE Business Intelligence
Post #1385530
revathiganesh55
revathiganesh55
Posted Friday, November 16, 2012 1:32 AM
Forum Newbie
Group: General Forum Members
Last Login: 2 days ago @ 6:02 AM
Points: 3,
Visits: 149
I am able to add the newly added columns in my package via C# but am not able to map the columns using my reference table in DB. Also here my Source and Destination column names can be different.
Post #1385532
Koen Verbeeck
Koen Verbeeck
Posted Friday, November 16, 2012 1:34 AM
SSCrazy Eights
Group: General Forum Members
Last Login: Yesterday @ 6:54 AM
Points: 9,364,
Visits: 6,462
I know you can change the source and destination tables dynamically, but I have no clue how you would handle the changing metadata.
How to post forum questions.
Need an answer? No, you need a question.
What’s the deal with Excel & SSIS?
Member of
LinkedIn
. My blog at
LessThanDot
.
MCSA SQL Server 2012 - MCSE Business Intelligence
Post #1385533
Hardy21
Hardy21
Posted Monday, March 04, 2013 12:40 PM
SSC Eights!
Group: General Forum Members
Last Login: Monday, May 13, 2013 2:42 PM
Points: 877,
Visits: 1,158
Koen Verbeeck (11/16/2012)
I know you can change the source and destination tables dynamically, but I have no clue how you would handle the changing metadata.
I am able to modify table names dynamically in data flow tasks. But, I need to change destination column names dynamically. How can we do that?
Thanks
Post #1426416
Evil Kraig F
Evil Kraig F
Posted Monday, March 04, 2013 12:55 PM
SSCertifiable
Group: General Forum Members
Last Login: Yesterday @ 6:03 PM
Points: 5,658,
Visits: 6,099
There are things you can change easily in an SSIS package dynamically. The easy way to tell if you can is if they're in the list of properties under expressions for the source/destination or the datasource itself.
There are things you CAN'T change easily in an SSIS package dynamically, one of which is the metadata of the dataflow. The dataflow uses internal IDs based on the object that 'sources' the column to determine its type, value, and other items. There are third party objects out there that can allow you to have some variable source constructions, but even they are limited to having the same output results into the metadata (at least for used columns).
SSIS isn't meant to be that dynamic. In the same way that you need to write dynamic T-SQL to allow for major changes to queries, you need to write dynamic packages to account for variable metadata. This is nowhere near as easy as dynamic SQL however, and will require a pretty solid background in coding.
- Craig Farrell
Never stop learning, even if it hurts. Ego bruises are practically mandatory as you learn unless you've never risked enough to make a mistake.
For better assistance in answering your questions
|
Forum Netiquette
For index/tuning help, follow these directions.
|
Tally Tables
Twitter: @AnyWayDBA
Post #1426422
Hardy21
Hardy21
Posted Wednesday, March 06, 2013 11:52 AM
SSC Eights!
Group: General Forum Members
Last Login: Monday, May 13, 2013 2:42 PM
Points: 877,
Visits: 1,158
Evil Kraig F (3/4/2013)
There are things you can change easily in an SSIS package dynamically. The easy way to tell if you can is if they're in the list of properties under expressions for the source/destination or the datasource itself.
There are things you CAN'T change easily in an SSIS package dynamically, one of which is the metadata of the dataflow. The dataflow uses internal IDs based on the object that 'sources' the column to determine its type, value, and other items. There are third party objects out there that can allow you to have some variable source constructions, but even they are limited to having the same output results into the metadata (at least for used columns).
SSIS isn't meant to be that dynamic. In the same way that you need to write dynamic T-SQL to allow for major changes to queries, you need to write dynamic packages to account for variable metadata. This is nowhere near as easy as dynamic SQL however, and will require a pretty solid background in coding.
I am able to update column names.
Thanks
Post #1427566
« Prev Topic
|
Next Topic »
Permissions
You
cannot
post new topics.
You
cannot
post topic replies.
You
cannot
post new polls.
You
cannot
post replies to polls.
You
cannot
edit your own topics.
You
cannot
delete your own topics.
You
cannot
edit other topics.
You
cannot
delete other topics.
You
cannot
edit your own posts.
You
cannot
edit other posts.
You
cannot
delete your own posts.
You
cannot
delete other posts.
You
cannot
post events.
You
cannot
edit your own events.
You
cannot
edit other events.
You
cannot
delete your own events.
You
cannot
delete other events.
You
cannot
send private messages.
You
cannot
send emails.
You
may
read topics.
You
cannot
rate topics.
You
cannot
vote within polls.
You
cannot
upload attachments.
You
may
download attachments.
You
cannot
post HTML code.
You
cannot
edit HTML code.
You
cannot
post IFCode.
You
cannot
post JavaScript.
You
cannot
post EmotIcons.
You
cannot
post or upload images.
Copyright © 2002-2013 Simple Talk Publishing. All Rights Reserved.
Privacy Policy.
Terms of Use.
Report Abuse.