Click here to monitor SSC
SQLServerCentral is supported by Red Gate Software Ltd.
 
Log in  ::  Register  ::  Not logged in
 
 
 
        
Home       Members    Calendar    Who's On


Add to briefcase «««12345»»»

no matter how large the destination column eg. nvarchar(max), excel source choke on column Expand / Collapse
Author
Message
Posted Thursday, May 16, 2013 1:50 PM


SSC-Insane

SSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-Insane

Group: General Forum Members
Last Login: Yesterday @ 7:35 PM
Points: 22,992, Visits: 31,471
KoldCoffee (5/16/2013)



shop air compressor - Speedaire State of Washington pressure vessel ID = 33501-03W





looks like browser is converting the characters in my excel from HTML to human readable code. No matter what I do, I can't show you exactly what's in my excel source, but it's not pretty. It's html gobbelty goop

the asset description is actually populated with a bunch of hash marks, ampersands, and semi colons, all of which disappear into nice html when I click save.....


I know you don't want to hear from me but two things, the first a question. Do you see the same gobbelty goop in other rows for the same column or in the other column you are having problems with?

Second, those characters we don't see when you post are two carrage return-linefeed combinations (could see them when I clicked to quote reply just to see what was there).



Lynn Pettis

For better assistance in answering your questions, click here
For tips to get better help with Performance Problems, click here
For Running Totals and its variations, click here or when working with partitioned tables
For more about Tally Tables, click here
For more about Cross Tabs and Pivots, click here and here
Managing Transaction Logs

SQL Musings from the Desert Fountain Valley SQL (My Mirror Blog)
Post #1453767
Posted Thursday, May 16, 2013 1:59 PM
SSChasing Mays

SSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing Mays

Group: General Forum Members
Last Login: Sunday, July 20, 2014 8:39 AM
Points: 605, Visits: 1,406
I've attached a sample of my source Excel 97-2003 file, 20 rows and a good portion of the columns including the offending columns: Asset Comments and Asset Description.

it helps to talk it out

  Post Attachments 
sample.xls (9 views, 43.00 KB)
Post #1453770
Posted Thursday, May 16, 2013 2:03 PM


SSC Eights!

SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!SSC Eights!

Group: General Forum Members
Last Login: Yesterday @ 11:38 AM
Points: 896, Visits: 7,072
I've had the problem with the column metadata reverting too. It usually happens when I've built the package by going through the import wizard and saved it to work on later. The only way I got around it was to start over and build the package from scratch in Visual Studio. Don't know why that happens. (IIRC is just shorthand for 'if I recall correctly').



And then again, I might be wrong ...
David Webb
Post #1453771
Posted Thursday, May 16, 2013 2:06 PM
SSChasing Mays

SSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing Mays

Group: General Forum Members
Last Login: Sunday, July 20, 2014 8:39 AM
Points: 605, Visits: 1,406
I did build it from scratch in BIDS 2010 (did not use import export wizard).

it helps to talk it out
Post #1453772
Posted Thursday, May 16, 2013 2:07 PM


SSC-Insane

SSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-Insane

Group: General Forum Members
Last Login: Yesterday @ 7:35 PM
Points: 22,992, Visits: 31,471
Going out on a limb here and replying again. Take a sample of the spreadsheet, clean up the offending columns by replacing the & #13;& #10;& #13;& #10; (put a space after the & so you could see them in the post) with a space. Then use that file as a source to your SSIS package and see if it works.

Pretty sure that the html encoded carrage return/line feeds are your problem.



Lynn Pettis

For better assistance in answering your questions, click here
For tips to get better help with Performance Problems, click here
For Running Totals and its variations, click here or when working with partitioned tables
For more about Tally Tables, click here
For more about Cross Tabs and Pivots, click here and here
Managing Transaction Logs

SQL Musings from the Desert Fountain Valley SQL (My Mirror Blog)
Post #1453773
Posted Thursday, May 16, 2013 2:18 PM
SSChasing Mays

SSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing Mays

Group: General Forum Members
Last Login: Sunday, July 20, 2014 8:39 AM
Points: 605, Visits: 1,406
anyone have a better idea? Obviously, this isn't feasible long term solution. Clearly the problem is with columns containing the html characters in the problem columns. Need excel source to bring them in.

it helps to talk it out
Post #1453776
Posted Thursday, May 16, 2013 3:00 PM


SSC-Insane

SSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-Insane

Group: General Forum Members
Last Login: Yesterday @ 7:35 PM
Points: 22,992, Visits: 31,471
FYI, looks like you have embedded <cr><lf> in other rows as well.

Looking to see if there is an other alternative but haven't found anything yet myself. Hopefully some one else will.



Lynn Pettis

For better assistance in answering your questions, click here
For tips to get better help with Performance Problems, click here
For Running Totals and its variations, click here or when working with partitioned tables
For more about Tally Tables, click here
For more about Cross Tabs and Pivots, click here and here
Managing Transaction Logs

SQL Musings from the Desert Fountain Valley SQL (My Mirror Blog)
Post #1453791
Posted Thursday, May 16, 2013 4:44 PM
SSChasing Mays

SSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing MaysSSChasing Mays

Group: General Forum Members
Last Login: Sunday, July 20, 2014 8:39 AM
Points: 605, Visits: 1,406
So folks, I take it, from the lack of response, that importing from excel columns of data containing all those characters we associate with html source code isn't going to work.

Case closed?

Funny thing is, for the sake of showing how much better it will be going to the source directly created it's own set of data mapping errors. But, I'm going to see if avoiding excel as source (which takes it's data from SQL anyway) is going to prove faster.



it helps to talk it out
Post #1453810
Posted Thursday, May 16, 2013 4:54 PM


SSC-Insane

SSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-InsaneSSC-Insane

Group: General Forum Members
Last Login: Yesterday @ 7:35 PM
Points: 22,992, Visits: 31,471
opc.three (5/16/2013)
The whole post is a good read, but section "The solution part III" pertains to your issue specifically:

http://blogs.lessthandot.com/index.php/DataMgmt/ssis-1/what-s-the-deal-with


Link appears broken.

Edit: Apparently my attempt to fix didn't help either.




Lynn Pettis

For better assistance in answering your questions, click here
For tips to get better help with Performance Problems, click here
For Running Totals and its variations, click here or when working with partitioned tables
For more about Tally Tables, click here
For more about Cross Tabs and Pivots, click here and here
Managing Transaction Logs

SQL Musings from the Desert Fountain Valley SQL (My Mirror Blog)
Post #1453811
Posted Thursday, May 16, 2013 6:36 PM


SSCertifiable

SSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiableSSCertifiable

Group: General Forum Members
Last Login: 2 days ago @ 4:52 PM
Points: 7,079, Visits: 12,569
Weird. Link works for me, still.

Kold Koffee. We're volunteers so the lack of a response within a few minutes ir even hours just means we may have had to do something for $ before we could get back to your issue. I will have a look tonight or tomorrow morning at the file you posted.


__________________________________________________________________________________________________
There are no special teachers of virtue, because virtue is taught by the whole community. --Plato
Post #1453816
« Prev Topic | Next Topic »

Add to briefcase «««12345»»»

Permissions Expand / Collapse