Home Forums Data Warehousing Integration Services multiple files with some columns are same and some columns are different but i have to load all this columns into single columns how RE: multiple files with some columns are same and some columns are different but i have to load all this columns into single columns how

  • February 9, 2014 at 7:53 am

    #1687367

    How many files are we talking about and also how many different layouts?

    Multiple data flows (one per file type) is one way of handling this.

    Another is to send all of the data to a script component and use that to handle the layout variations, in a single dataflow. In this case, your base file connection should define the entire row as a single string, to avoid any meta data issues between files.

    Use a FOREACH container to iterate round the files (your dataflow will go in here).

    If your C# is decent, the scripted option is likely to be tidier, in my opinion.

    If you haven't even tried to resolve your issue, please don't expect the hard-working volunteers here to waste their time providing links to answers which you could easily have found yourself.