Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase «««12345»»»

no matter how large the destination column eg. nvarchar(max), excel source choke on column Expand / Collapse
Author
Message
Posted Thursday, May 16, 2013 1:50 PM


SSC-Insane

SSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-Insane

Group: General Forum Members
Last Login: Today @ 5:23 PM
Points: 22,492, Visits: 30,194
KoldCoffee (5/16/2013)



shop air compressor - Speedaire State of Washington pressure vessel ID = 33501-03W





looks like browser is converting the characters in my excel from HTML to human readable code. No matter what I do, I can't show you exactly what's in my excel source, but it's not pretty. It's html gobbelty goop

the asset description is actually populated with a bunch of hash marks, ampersands, and semi colons, all of which disappear into nice html when I click save.....


I know you don't want to hear from me but two things, the first a question. Do you see the same gobbelty goop in other rows for the same column or in the other column you are having problems with?

Second, those characters we don't see when you post are two carrage return-linefeed combinations (could see them when I clicked to quote reply just to see what was there).



Lynn Pettis

For better assistance in answering your questions, click here
For tips to get better help with Performance Problems, click here
For Running Totals and its variations, click here or when working with partitioned tables
For more about Tally Tables, click here
For more about Cross Tabs and Pivots, click here and here
Managing Transaction Logs

SQL Musings from the Desert Fountain Valley SQL (My Mirror Blog)
Post #1453767
Posted Thursday, May 16, 2013 1:59 PM
Mr or Mrs. 500

Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500

Group: General Forum Members
Last Login: Sunday, April 13, 2014 5:45 PM
Points: 519, Visits: 1,209
I've attached a sample of my source Excel 97-2003 file, 20 rows and a good portion of the columns including the offending columns: Asset Comments and Asset Description.

  Post Attachments 
sample.xls (9 views, 43.00 KB)
Post #1453770
Posted Thursday, May 16, 2013 2:03 PM


SSC Eights!

SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!

Group: General Forum Members
Last Login: Today @ 5:44 PM
Points: 893, Visits: 6,894
I've had the problem with the column metadata reverting too. It usually happens when I've built the package by going through the import wizard and saved it to work on later. The only way I got around it was to start over and build the package from scratch in Visual Studio. Don't know why that happens. (IIRC is just shorthand for 'if I recall correctly').



And then again, I might be wrong ...
David Webb
Post #1453771
Posted Thursday, May 16, 2013 2:06 PM
Mr or Mrs. 500

Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500

Group: General Forum Members
Last Login: Sunday, April 13, 2014 5:45 PM
Points: 519, Visits: 1,209
I did build it from scratch in BIDS 2010 (did not use import export wizard).
Post #1453772
Posted Thursday, May 16, 2013 2:07 PM


SSC-Insane

SSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-Insane

Group: General Forum Members
Last Login: Today @ 5:23 PM
Points: 22,492, Visits: 30,194
Going out on a limb here and replying again. Take a sample of the spreadsheet, clean up the offending columns by replacing the & #13;& #10;& #13;& #10; (put a space after the & so you could see them in the post) with a space. Then use that file as a source to your SSIS package and see if it works.

Pretty sure that the html encoded carrage return/line feeds are your problem.



Lynn Pettis

For better assistance in answering your questions, click here
For tips to get better help with Performance Problems, click here
For Running Totals and its variations, click here or when working with partitioned tables
For more about Tally Tables, click here
For more about Cross Tabs and Pivots, click here and here
Managing Transaction Logs

SQL Musings from the Desert Fountain Valley SQL (My Mirror Blog)
Post #1453773
Posted Thursday, May 16, 2013 2:18 PM
Mr or Mrs. 500

Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500

Group: General Forum Members
Last Login: Sunday, April 13, 2014 5:45 PM
Points: 519, Visits: 1,209
anyone have a better idea? Obviously, this isn't feasible long term solution. Clearly the problem is with columns containing the html characters in the problem columns. Need excel source to bring them in.
Post #1453776
Posted Thursday, May 16, 2013 3:00 PM


SSC-Insane

SSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-Insane

Group: General Forum Members
Last Login: Today @ 5:23 PM
Points: 22,492, Visits: 30,194
FYI, looks like you have embedded <cr><lf> in other rows as well.

Looking to see if there is an other alternative but haven't found anything yet myself. Hopefully some one else will.



Lynn Pettis

For better assistance in answering your questions, click here
For tips to get better help with Performance Problems, click here
For Running Totals and its variations, click here or when working with partitioned tables
For more about Tally Tables, click here
For more about Cross Tabs and Pivots, click here and here
Managing Transaction Logs

SQL Musings from the Desert Fountain Valley SQL (My Mirror Blog)
Post #1453791
Posted Thursday, May 16, 2013 4:44 PM
Mr or Mrs. 500

Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500Mr or Mrs. 500

Group: General Forum Members
Last Login: Sunday, April 13, 2014 5:45 PM
Points: 519, Visits: 1,209
So folks, I take it, from the lack of response, that importing from excel columns of data containing all those characters we associate with html source code isn't going to work.

Case closed?

Funny thing is, for the sake of showing how much better it will be going to the source directly created it's own set of data mapping errors. But, I'm going to see if avoiding excel as source (which takes it's data from SQL anyway) is going to prove faster.

Post #1453810
Posted Thursday, May 16, 2013 4:54 PM


SSC-Insane

SSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-Insane

Group: General Forum Members
Last Login: Today @ 5:23 PM
Points: 22,492, Visits: 30,194
opc.three (5/16/2013)
The whole post is a good read, but section "The solution part III" pertains to your issue specifically:

http://blogs.lessthandot.com/index.php/DataMgmt/ssis-1/what-s-the-deal-with


Link appears broken.

Edit: Apparently my attempt to fix didn't help either.




Lynn Pettis

For better assistance in answering your questions, click here
For tips to get better help with Performance Problems, click here
For Running Totals and its variations, click here or when working with partitioned tables
For more about Tally Tables, click here
For more about Cross Tabs and Pivots, click here and here
Managing Transaction Logs

SQL Musings from the Desert Fountain Valley SQL (My Mirror Blog)
Post #1453811
Posted Thursday, May 16, 2013 6:36 PM


SSCertifiable

SSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiable

Group: General Forum Members
Last Login: 2 days ago @ 9:25 AM
Points: 7,070, Visits: 12,523
Weird. Link works for me, still.

Kold Koffee. We're volunteers so the lack of a response within a few minutes ir even hours just means we may have had to do something for $ before we could get back to your issue. I will have a look tonight or tomorrow morning at the file you posted.


__________________________________________________________________________________________________
There are no special teachers of virtue, because virtue is taught by the whole community. --Plato

Believe you can and you're halfway there. --Theodore Roosevelt

Everything Should Be Made as Simple as Possible, But Not Simpler --Albert Einstein

The significant problems we face cannot be solved at the same level of thinking we were at when we created them. --Albert Einstein

1 apple is not exactly 1/8 of 8 apples. Because there are no absolutely identical apples. --Giordy
Post #1453816
« Prev Topic | Next Topic »

Add to briefcase «««12345»»»

Permissions Expand / Collapse