Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase ««12

SSIS-Data in multiple .csv files to columns in same csv file Expand / Collapse
Author
Message
Posted Wednesday, May 15, 2013 12:35 AM
SSC Rookie

SSC RookieSSC RookieSSC RookieSSC RookieSSC RookieSSC RookieSSC RookieSSC Rookie

Group: General Forum Members
Last Login: 2 days ago @ 11:15 AM
Points: 38, Visits: 183
AutoGenrating Identity solves,but the data is in Text file and there are around 700 files which needs to be processed
Post #1452935
Posted Wednesday, May 15, 2013 8:29 AM


SSCertifiable

SSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiable

Group: General Forum Members
Last Login: Today @ 8:24 AM
Points: 7,133, Visits: 6,295
In several other packages, here's what I did. I had to actually do a Multicast to do derived columns. Then I pulled those columns together with a UNION ALL. The UNION did not require an identity. I know this because I just replicated what I've previously done.

So you should be able to just put the multiple file sources into a Data Flow task and join them together with a UNION ALL. The trick is you need the same # of columns, in that order, and have the same metadata for each column.

Easy Peasy, no identitifier required.


Brandie Tarvin, MCITP Database Administrator

Webpage: http://www.BrandieTarvin.net
LiveJournal Blog: http://brandietarvin.livejournal.com/
On LinkedIn!, Google+, and Twitter.

Freelance Writer: Shadowrun
Latchkeys: Nevermore, Latchkeys: The Bootleg War, and Latchkeys: Roscoes in the Night are now available on Nook and Kindle.
Post #1453126
« Prev Topic | Next Topic »

Add to briefcase ««12

Permissions Expand / Collapse