Post reply

Loading flat files with different file formats

  • March 6, 2009 at 2:50 pm

    #202117

    Hello all, I'm new to SSIS (former Informatica developer) and trying to load multiple flat files into one table. Each of the files will have the same columns but they will be in different order. Don't ask why we can't get columns in the same format :crazy: . Additionally, the files will have column headers in the first row and the file is delimted by a "|" .

    Is there a way to load these files without coding a new package for each file format possible?

    Thanks!

  • March 9, 2009 at 6:39 am

    #955919

    Just add a flat file connection manager for each different file. Then, in your data flow, use them as multiple sources, join them with a UNION (works faster than a merge) and send them to your destination.

    Or, if you want faster & parallel processing, use them as multiple sources, then just copy the same destination over and over again, one destination for each source.

    You can do it all in the same package and all in the same Data Flow task.

    Brandie Tarvin, MCITP Database AdministratorLiveJournal Blog: http://brandietarvin.livejournal.com/[/url]On LinkedIn!, Google+, and Twitter.Freelance Writer: ShadowrunLatchkeys: Nevermore, Latchkeys: The Bootleg War, and Latchkeys: Roscoes in the Night are now available on Nook and Kindle.

  • March 9, 2009 at 8:04 am

    #956013

    Thanks for the response Brandie!

  • March 9, 2009 at 8:26 am

    #956045

    NP. Hope it helps. @=)

    Brandie Tarvin, MCITP Database AdministratorLiveJournal Blog: http://brandietarvin.livejournal.com/[/url]On LinkedIn!, Google+, and Twitter.Freelance Writer: ShadowrunLatchkeys: Nevermore, Latchkeys: The Bootleg War, and Latchkeys: Roscoes in the Night are now available on Nook and Kindle.

Viewing 4 posts - 1 through 4 (of 4 total)

You must be logged in to reply to this topic. Login to reply