Is there any way around this without doing some crazy file manipulation?
1) Use a delimiter which does not appear in your data.
2) Use SSIS 2012 onwards. See here.
If you haven't even tried to resolve your issue, please don't expect the hard-working volunteers here to waste their time providing links to answers which you could easily have found yourself.