First SSIS package.... isolated one error to one 4000 character column

  • I have an SSIS package with a) Sharepoint List Source, b) Data Conversion, c) OLE DB destination.

    I had to use the data conversion component in order to change the string data from Unicode.

    All fields come over fine except for a column that basically contains some HTML code. It comes in as a 4000 character field, and I get this error even if I truncate the data in the conversion component.

    Here's the error:

    [SharePoint List Source [1]] Error: Microsoft.SqlServer.Dts.Pipeline.DoesNotFitBufferException: The value is too large to fit in the column data area of the buffer. at Microsoft.SqlServer.Dts.Pipeline.PipelineBuffer.SetString(Int32 columnIndex, String value) at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.PrimeOutput(Int32 outputs, Int32[] outputIDs, PipelineBuffer[] buffers) at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostPrimeOutput(IDTSManagedComponentWrapper90 wrapper, Int32 outputs, Int32[] outputIDs, IDTSBuffer90[] buffers, IntPtr ppBufferWirePacket)

    Here's what the data in field looks like:

    <div class=ExternalClass27637224667E4692AA7B7B0B2059FBE0><div id="_Note_9023a1eb-e648-4fac-aaa6-b7b5e38a628f" class="mmt_noteItem"><div class="mmt_noteHeader"><table><tr><td class="mmt_noteCreated">7/15/2010 4:03:28 PM</td><td class="mmt_noteAuthor">MEMEN

    What can I do to pull this over? There is some usable data in the field, and I can parse it once I get it into SQL. Do I have to add some new task to the DTS?

    I'm new to Integration Services...

    Thanks.

  • If I'm reading that right it's not the VARCHAR() causing the problem, it's the INT32 field. Something in the source data is one REALLY big number.


    - Craig Farrell

    Never stop learning, even if it hurts. Ego bruises are practically mandatory as you learn unless you've never risked enough to make a mistake.

    For better assistance in answering your questions[/url] | Forum Netiquette
    For index/tuning help, follow these directions.[/url] |Tally Tables[/url]

    Twitter: @AnyWayDBA

  • Addendum, some googled links on the topic:

    http://jetlounge.net/blogs/teched/archive/2009/02/03/fix-ssis-script-component-error-quot-the-value-is-too-large-to-fit-in-the-column-data-area-of-the-buffer-quot.aspx

    The last post of this:

    http://www.sqlbi.com/Default.aspx?tabid=72&forumid=12&threadid=665&scope=posts

    These all point to making sure the destination is as large as the source, even with manipulation.

    This may help a programmer understand more of this:

    http://msdn.microsoft.com/en-us/microsoft.sqlserver.dts.pipeline.doesnotfitbufferexception.aspx

    which was linked off this article:

    http://social.msdn.microsoft.com/forums/en-US/sqlintegrationservices/thread/e95c1fda-bedb-4a8b-b90d-12c6c8779b30/


    - Craig Farrell

    Never stop learning, even if it hurts. Ego bruises are practically mandatory as you learn unless you've never risked enough to make a mistake.

    For better assistance in answering your questions[/url] | Forum Netiquette
    For index/tuning help, follow these directions.[/url] |Tally Tables[/url]

    Twitter: @AnyWayDBA

Viewing 3 posts - 1 through 3 (of 3 total)

You must be logged in to reply to this topic. Login to reply