Home Forums Data Warehousing Integration Services SSIS 2008 – Read roughly 50 CSV files from a folder, create SQL table from them dynamically, and dump data. RE: SSIS 2008 – Read roughly 50 CSV files from a folder, create SQL table from them dynamically, and dump data.

  • April 21, 2015 at 9:03 am

    #1792445

    ankithimmatlalshah (4/20/2015)

    Hello Phil,

    I'm really sorry, it's yourself only.

    Instead of Phil I specified Chris in my previous reply.

    Client has provided one PDF file that contains the details about each column for every CSV file.

    Sorry for the confusion, I would not like to read the PDF file vis SSIS package.

    Actually, I'm panning to prepare the SQL scripts manually based on the detail to generate tables at staging database.

    I'm going to propose the following plan to customer,

    Step 1 - SQL script task, which will prepare the schema for 50 CSV files

    Step 2- For each container,

    Here it will pick each CSV file and insert/append it's data to respective SQL tables.

    I think I need to consider the various variables, roughly 50 variables to manage the things dynamically.

    Please advise if you know any other elegant way to achieve aforementioned steps.

    Thanks,

    Ankit

    Is there any duplication of the format and column names of the files in these 50?

    --Jeff Moden

    RBAR is pronounced "ree-bar" and is a "Modenism" for Row-By-Agonizing-Row.
    First step towards the paradigm shift of writing Set Based code:
    ________Stop thinking about what you want to do to a ROW... think, instead, of what you want to do to a COLUMN.

    Change is inevitable... Change for the better is not.

    Helpful Links:
    How to post code problems
    How to Post Performance Problems
    Create a Tally Function (fnTally)