• Yuck. Ugly. It's a little tough to diagnose the specific problems you're having without the code for your scripts/regex.

    You've got no consistency either within records or across records with the use of commas and quotes as field separators vs embedded characters. MS Office processes delimiters differently than SQL Server and SSIS so what works in Access/Excel isn't a good indicator of how SSIS handles it.

    If you have any control or influence over the creation of the source data, see if you can't have the file created with a tab or pipe (|) character.

    If not, really your best bet is to do what you've been trying: do some preprocessing on each line of the file before trying to import. RegEx isn't *that* hard, but it does take practice. There are a number of websites around that can help you test your RegEx.

    I've also had some success importing files like this into a table where each line of the input file is a record in a varchar(max) field, then using T-SQL REPLACE() and SUBSTRING() in a stored procedure.

    ____________
    Just my $0.02 from over here in the cheap seats of the peanut gallery - please adjust for inflation and/or your local currency.