OK I seem to have identified the source of this issue...

My destination table has more rows than my flat file and they are in a different order.

I thought bcp was supposed to work when there was a different number of rows but it would appear that is only one sided...

I have worked around this by implementing a staging table.