• Is there any way around this without doing some crazy file manipulation?

    1) Use a delimiter which does not appear in your data.

    2) Use SSIS 2012 onwards. See here.