Post reply

csv file with dynamic field counts

  • December 18, 2020 at 5:18 am

    #3821884

    i have a csv file with dynamic field counts that i need to import into a table using data flow task in ssis. The expected field count in the file is 10.Need to skip any rows where the field count is anything other than 10 . The file has " as text qualifier and  need  ignore the delimiter (,)  within the qualifier. What would be the best way to do this using ssis? Thanks.

  • December 18, 2020 at 9:38 am

    #3821941

    SSIS does not handle this scenario very well without code. The way I would do it is as follows:

    • Set up a dataflow to read every row of the source file as a single column
    • Using a Script Component to parse out the actual columns and discard (or redirect) those rows with incorrect column counts. The output of the Script Component will be the columns you are interested in.

    If you haven't even tried to resolve your issue, please don't expect the hard-working volunteers here to waste their time providing links to answers which you could easily have found yourself.

Viewing 2 posts - 1 through 1 (of 1 total)

You must be logged in to reply to this topic. Login to reply