Using the Konesans File Watcher Task in SSIS to Process Data Files
With the Konesans File Watcher Task for SSIS we can import files as soon as they arrive.
2014-10-10 (first published: 2012-08-13)
18,999 reads
Integration Services (SSIS)
Regular Expression Transformation
The regular expression transformation exposes the power of regular expression matching within the pipeline. One or more columns can be selected, and for each column an individual expression can be applied. The way multiple columns are handled can be set on the options page.
2012-08-10
3,946 reads
Working with SSIS Data Types
In order to be able to take data from a variety of sources, manipulate it, and then export it to one of several destinations, SSIS has to use its own data types. If you hit problems, then you may need to intervene to ensure an appropriate conversion.
2012-08-08
3,143 reads
RegexClean Transformation
Use the power of regular expressions to cleanse your data right there inside the Data Flow. This transformation includes a full user interface for simple configuration, as well as advanced features such as error output configuration. Two regular expressions are used, a match expression and a replace expression. The transformation is designed around the named capture groups or match groups, and even supports multiple expressions.
2012-08-03
3,279 reads
Data Generator Source Adapter
This component needs little explanation. It generates random integer (DT_I4) and string (DT_WSTR) data and places them in the pipeline. You specify how many columns of each you would like and for any string columns you pass a fixed length value. You then need to specify how many rows in total you require to be generated. This component is used by us to do testing of the pipeline and components downstream.
2012-07-27
2,236 reads
SSIS Basics: Adding Data Flow to Your Package
Annette continues her popular series for SSIS beginners by showing how a data flow task can be used in a package to move data from a SQL Server database to an Excel file, and insert an additional column into the Excel file that’s based on derived data.
2012-07-19
3,555 reads
Checksum Transformation
The Checksum Transformation computes a hash value, the checksum, across one or more columns, returning the result in the Checksum output column. The transformation provides functionality similar to the T-SQL CHECKSUM function, but is encapsulated within SQL Server Integration Services, for use within the pipeline without code or a SQL Server connection. As featured in The Microsoft Data Warehouse Toolkit by Joy Mundy and Warren Thornthwaite from the Kimbal Group.
2012-07-18
2,729 reads
File Watcher Task
The task will detect changes to existing files as well as new files, both actions will cause the file to be found when available. A file is available when the task can open it exclusively. This is important for files that take a long time to be written, such as large files, or those that are just written slowly or delivered via a slow network link.
2012-07-13
3,590 reads
SQL Server 2012 Integration Services- Using Environments in Package Execution
SQL Server 2012 Integration Services offers several different options for deploying and storing SSIS packages along with their associated projects, two of which are directly related to two deployment models available in SQL Server Data Tools console. Marcin Policht presents one of these methods, which deals with packages deployed using Project Deployment Model and leverages newly introduced Environments.
2012-07-09
2,715 reads
Trash Destination Adapter
The Trash Destination and this article came from early experiences of using SSIS and community feedback at the time. When developing a package it is very useful to have a destination adapter that does nothing but consume rows with no setup requirement. You often want run a package part way through development, or just add a path so you can set a Data Viewer. There are stock tasks that can be used, but with the Trash Destination all columns are treated as selected automatically (usage type of read-only), so the pipeline knows they are required.
2012-07-06
2,532 reads
Blogs
Creating a Striped Backup Set with AI
By Steve Jones
I needed to test a striped backup, so I decided to ask the AI’s...
Trace Flag 1448 – Lessons from a Technical Interview
By gbargsley
In SQL Server environments where transactional replication runs alongside Always On Availability Groups (AGs),...
Disable the sa login in SQL Server (and sleep better)
Disable the sa login in SQL Server (and sleep better)If you run SQL Server...
Forums
Create an HTML Report on the Status of SQL Server Agent Jobs
Comments posted to this topic are about the item Create an HTML Report on...
Be Wary of Data
Comments posted to this topic are about the item Be Wary of Data
Locking Hierarchies
Comments posted to this topic are about the item Locking Hierarchies
Question of the Day
Locking Hierarchies
You have a table [dbo].[orders] without a Clustered Index (Heap). The table does not have any other nonclustered indexes! You rund the following command in Read Committed Isolation Level:
SELECTo_orderdate,
o_orderkey,
o_custkey,
o_storekey
FROMdbo.orders
WHEREo_orderkey = 3877;