Click here to monitor SSC
SQLServerCentral is supported by Redgate
 
Log in  ::  Register  ::  Not logged in
 
 
 


What transformations will I need?


What transformations will I need?

Author
Message
Jake Shelton
Jake Shelton
SSC-Enthusiastic
SSC-Enthusiastic (181 reputation)SSC-Enthusiastic (181 reputation)SSC-Enthusiastic (181 reputation)SSC-Enthusiastic (181 reputation)SSC-Enthusiastic (181 reputation)SSC-Enthusiastic (181 reputation)SSC-Enthusiastic (181 reputation)SSC-Enthusiastic (181 reputation)

Group: General Forum Members
Points: 181 Visits: 916
Hi all, we are rewriting a large number of DTS packages, I have done a quick sample audit of the packages, typically they involve any combination of the below;

1) Deletion of existing files,
2) Running a SQL statement or batch file,
3) Connecting to a SQL/Excel source/destination, importing or exporting data to or from it;
4) Sending emails indicating which of the previous elements failed, or overall success.


There are several packages containing ActiveX Scripting, though they SEEM only to either check whether a csv/txt file exists, rename it, or make a copy of it to a network drive and delete the original.

What are transformations in SSIS I need to create the packages?

Thanks,

JB
Koen Verbeeck
Koen Verbeeck
SSCoach
SSCoach (16K reputation)SSCoach (16K reputation)SSCoach (16K reputation)SSCoach (16K reputation)SSCoach (16K reputation)SSCoach (16K reputation)SSCoach (16K reputation)SSCoach (16K reputation)

Group: General Forum Members
Points: 16522 Visits: 13210
1. File System Task
2. Execute SQL Task (SQL) or Execute Process Task (batch)
3. Data Flow with corresponding sources and destinations.
4. Send Mail Task

The SSIS development team really did their best to choose logical names for the components ;-)

ActiveX --> Script Task.



How to post forum questions.
Need an answer? No, you need a question.
What’s the deal with Excel & SSIS?

Member of LinkedIn. My blog at SQLKover.

MCSA SQL Server 2012 - MCSE Business Intelligence
SQLRNNR
SQLRNNR
SSC-Insane
SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)

Group: General Forum Members
Points: 21125 Visits: 18259
For the deletion of the files you could also use a Script Task. I find it to be more useful than the File system task in some cases.

If you wanted to get real tricky, you could do most of that stuff via Script tasks (delete the files, execute stored procs or adhoc queries and send mail) you'd just have to be a bit more adept at the programmatic means rather than the GUI. :-D



Jason AKA CirqueDeSQLeil
I have given a name to my pain...
MCM SQL Server, MVP


SQL RNNR

Posting Performance Based Questions - Gail Shaw

Jake Shelton
Jake Shelton
SSC-Enthusiastic
SSC-Enthusiastic (181 reputation)SSC-Enthusiastic (181 reputation)SSC-Enthusiastic (181 reputation)SSC-Enthusiastic (181 reputation)SSC-Enthusiastic (181 reputation)SSC-Enthusiastic (181 reputation)SSC-Enthusiastic (181 reputation)SSC-Enthusiastic (181 reputation)

Group: General Forum Members
Points: 181 Visits: 916
Cheers guys!!

Another question, I have a LOT of these to build, typically I'll only need 2-3 tasks and a couple of connections...


Is it possible/worthwhile using the Wizard to create?
SQLRNNR
SQLRNNR
SSC-Insane
SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)SSC-Insane (21K reputation)

Group: General Forum Members
Points: 21125 Visits: 18259
IMHO - I wouldn't use the wizard.



Jason AKA CirqueDeSQLeil
I have given a name to my pain...
MCM SQL Server, MVP


SQL RNNR

Posting Performance Based Questions - Gail Shaw

PB_BI
PB_BI
Ten Centuries
Ten Centuries (1.3K reputation)Ten Centuries (1.3K reputation)Ten Centuries (1.3K reputation)Ten Centuries (1.3K reputation)Ten Centuries (1.3K reputation)Ten Centuries (1.3K reputation)Ten Centuries (1.3K reputation)Ten Centuries (1.3K reputation)

Group: General Forum Members
Points: 1291 Visits: 2404
Jake Shelton (2/5/2014)
Cheers guys!!

Another question, I have a LOT of these to build, typically I'll only need 2-3 tasks and a couple of connections...


Is it possible/worthwhile using the Wizard to create?


If you have a lot of similar packages to create then you might want to look into using BIML via BIDSHelper http://bidshelper.codeplex.com/wikipage?title=Biml%20Package%20Generator&referringTitle=Documentation. With this small changes can be made and packages generated without having to drag-drop-edit over and over again.

Or with clever use of variables and looping you may be able to keep the entire task down to one package*

As for having only a couple of connections you can use project level connection managers and just call these in each package. :-)

*pure speculation seeing as I don't know the exact needs of your environment ;-)




I'm on LinkedIn
SQLCJ
SQLCJ
Mr or Mrs. 500
Mr or Mrs. 500 (539 reputation)Mr or Mrs. 500 (539 reputation)Mr or Mrs. 500 (539 reputation)Mr or Mrs. 500 (539 reputation)Mr or Mrs. 500 (539 reputation)Mr or Mrs. 500 (539 reputation)Mr or Mrs. 500 (539 reputation)Mr or Mrs. 500 (539 reputation)

Group: General Forum Members
Points: 539 Visits: 576
How about creating SSIS template ? and using it while creating all the packages
Jake Shelton
Jake Shelton
SSC-Enthusiastic
SSC-Enthusiastic (181 reputation)SSC-Enthusiastic (181 reputation)SSC-Enthusiastic (181 reputation)SSC-Enthusiastic (181 reputation)SSC-Enthusiastic (181 reputation)SSC-Enthusiastic (181 reputation)SSC-Enthusiastic (181 reputation)SSC-Enthusiastic (181 reputation)

Group: General Forum Members
Points: 181 Visits: 916
chetan.deshpande001 (2/6/2014)
How about creating SSIS template ? and using it while creating all the packages


Indeed, but can it store connection information, so as well as commonly repeating tasks, can the template store repeating sources/destinations?
Bruce W Cassidy
Bruce W Cassidy
Right there with Babe
Right there with Babe (787 reputation)Right there with Babe (787 reputation)Right there with Babe (787 reputation)Right there with Babe (787 reputation)Right there with Babe (787 reputation)Right there with Babe (787 reputation)Right there with Babe (787 reputation)Right there with Babe (787 reputation)

Group: General Forum Members
Points: 787 Visits: 1033
If you are creating a lot of them, you might want to check out BIML:
http://bimlscript.com/

It takes a wee while to learn how to drive it, but once you do, you can create templates and produce the SSIS packages that way.
Go


Permissions

You can't post new topics.
You can't post topic replies.
You can't post new polls.
You can't post replies to polls.
You can't edit your own topics.
You can't delete your own topics.
You can't edit other topics.
You can't delete other topics.
You can't edit your own posts.
You can't edit other posts.
You can't delete your own posts.
You can't delete other posts.
You can't post events.
You can't edit your own events.
You can't edit other events.
You can't delete your own events.
You can't delete other events.
You can't send private messages.
You can't send emails.
You can read topics.
You can't vote in polls.
You can't upload attachments.
You can download attachments.
You can't post HTML code.
You can't edit HTML code.
You can't post IFCode.
You can't post JavaScript.
You can post emoticons.
You can't post or upload images.

Select a forum

































































































































































SQLServerCentral


Search