Phil Parkin (1/12/2014)
Here is few more details
Backend - SQL server 2008 R2,SSIS installed
OS - Unix Env
We have many process running on unix ,connecting to sql server , BCP into sql tables , all are working fine .
Above sample data is a representation of actual data . But really there is a correction required on data file , but in case we are using this in windows env this not an issue . Either with SSIS or Informatica this works perfectly with no issue as we have column to column mapping . Since that we cannot ask to fix that issue.
OK. Then please answer my questions about your sample data. At the moment, it looks like:
c1 (blank),c2,c3,c4,c5
c1 (blank),c2 (blank),c3,c4,c5 (blank)
c1 (missing),c2,c3,c4,c5
My point? If columns can be missed out randomly from your source data, there is NO WAY ON EARTH to get it fixed by SSIS, which is lacking the necessary Paranormal Transformation.
If you are saying that only certain columns are missing, under certain circumstances, you need to explain the logic of what needs to be done please.
Columns are not missing here . I have 5 column here ,looks like this.
[Just a sample data ,but this is the format we load]
col1 col2 col3 col4 col5
USD1542.5214536xxxx
1542.5214536
EUR 1542.5214536xxxx