Using the Konesans File Watcher Task in SSIS to Process Data Files
With the Konesans File Watcher Task for SSIS we can import files as soon as they arrive.
2014-10-10 (first published: 2012-08-13)
19,015 reads
Integration Services (SSIS)
Regular Expression Transformation
The regular expression transformation exposes the power of regular expression matching within the pipeline. One or more columns can be selected, and for each column an individual expression can be applied. The way multiple columns are handled can be set on the options page.
2012-08-10
3,946 reads
Working with SSIS Data Types
In order to be able to take data from a variety of sources, manipulate it, and then export it to one of several destinations, SSIS has to use its own data types. If you hit problems, then you may need to intervene to ensure an appropriate conversion.
2012-08-08
3,143 reads
RegexClean Transformation
Use the power of regular expressions to cleanse your data right there inside the Data Flow. This transformation includes a full user interface for simple configuration, as well as advanced features such as error output configuration. Two regular expressions are used, a match expression and a replace expression. The transformation is designed around the named capture groups or match groups, and even supports multiple expressions.
2012-08-03
3,279 reads
Data Generator Source Adapter
This component needs little explanation. It generates random integer (DT_I4) and string (DT_WSTR) data and places them in the pipeline. You specify how many columns of each you would like and for any string columns you pass a fixed length value. You then need to specify how many rows in total you require to be generated. This component is used by us to do testing of the pipeline and components downstream.
2012-07-27
2,236 reads
SSIS Basics: Adding Data Flow to Your Package
Annette continues her popular series for SSIS beginners by showing how a data flow task can be used in a package to move data from a SQL Server database to an Excel file, and insert an additional column into the Excel file that’s based on derived data.
2012-07-19
3,555 reads
Checksum Transformation
The Checksum Transformation computes a hash value, the checksum, across one or more columns, returning the result in the Checksum output column. The transformation provides functionality similar to the T-SQL CHECKSUM function, but is encapsulated within SQL Server Integration Services, for use within the pipeline without code or a SQL Server connection. As featured in The Microsoft Data Warehouse Toolkit by Joy Mundy and Warren Thornthwaite from the Kimbal Group.
2012-07-18
2,729 reads
File Watcher Task
The task will detect changes to existing files as well as new files, both actions will cause the file to be found when available. A file is available when the task can open it exclusively. This is important for files that take a long time to be written, such as large files, or those that are just written slowly or delivered via a slow network link.
2012-07-13
3,590 reads
SQL Server 2012 Integration Services- Using Environments in Package Execution
SQL Server 2012 Integration Services offers several different options for deploying and storing SSIS packages along with their associated projects, two of which are directly related to two deployment models available in SQL Server Data Tools console. Marcin Policht presents one of these methods, which deals with packages deployed using Project Deployment Model and leverages newly introduced Environments.
2012-07-09
2,715 reads
Trash Destination Adapter
The Trash Destination and this article came from early experiences of using SSIS and community feedback at the time. When developing a package it is very useful to have a destination adapter that does nothing but consume rows with no setup requirement. You often want run a package part way through development, or just add a path so you can set a Data Viewer. There are stock tasks that can be used, but with the Trash Destination all columns are treated as selected automatically (usage type of read-only), so the pipeline knows they are required.
2012-07-06
2,532 reads
Blogs
Resetting on the AI hype train
By Brian Kelley
There's a great article from MIT Technology Review about resetting on the hype of...
A New Word: Etherness
By Steve Jones
etherness – n. the wistful feeling of looking around a gathering of loved ones,...
Vibe Coding a Login Tracking System
By Steve Jones
A customer was asking about tracking logins and logouts in Redgate Monitor. We don’t...
Forums
The Microsoft SQL Year in Review
Comments posted to this topic are about the item The Microsoft SQL Year in...
T-SQL in SQL Server 2025: The || Operator
Comments posted to this topic are about the item T-SQL in SQL Server 2025:...
Your Value from a Conference
Comments posted to this topic are about the item Your Value from a Conference
Question of the Day
UNISTR Basics
What does this code return in SQL Server 2025+? (assume the database has an appropriate collation)
SELECT UNISTR('Hello 4E16754C') AS 'A Classic';
A: 
B: 
See possible answers