Click here to monitor SSC
SQLServerCentral is supported by Redgate
Log in  ::  Register  ::  Not logged in
Home       Members    Calendar    Who's On

Add to briefcase ««12

Learn XML Expand / Collapse
Posted Thursday, May 3, 2012 8:40 AM

SSCarpal Tunnel

SSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal TunnelSSCarpal Tunnel

Group: General Forum Members
Last Login: Yesterday @ 2:28 PM
Points: 4,098, Visits: 9,188
peter-757102 (5/3/2012)
rmechaber (5/3/2012)
peter-757102 (5/3/2012)
They are unable to model their data properly and often do not handle escaping well, causing errors in individual elements. But XML escaping is extremely simple and requires only a few find/replace actions you can do in practically every programming environment. It is truly a lack of basic knowledge that is the culprit here. I developed a toolset to work around the encoding issue by dropping those specific objects of interest that have these errors and keep processing the rest of the document.

Indeed, as an XML novice I found escaping an extremely annoying and frustrating task. (This was to produce XML to be read by PHP for displaying on a website.) In addition, I couldn't find an easy way to write out XML from SQL to a file with an included XML header, so I have used a rather clunky work-around.

Would you have any good links/references about how to handle this?


There are several ways, but so far I only had to generate XML from the application layer and not SQL. Once you know how and when to escape data, the problem is reduced to nothing more then concatenating strings in a nativly efficient manner when using this method. For SQL specifically there are other ways as well, some likely more efficient (and complex), but I got no experience with them.

You could start with SELECT and the FOR XML clause for simple set representations in XML, but the output does not neccecarily match what you need to generate (XML works case sensitive for example).

Documentation for the FOR XML clause:

As for exporting data to a file, that is something I fould always lacking from T-SQL. Importing is easy and has faily good support, exporting not would be my number one wish for any new release! I hate DTS and any such overly complex replacement and just expect to be able to specify an output file in my SQL clause and be done with it (for the sake of both sanity and efficiency).

I assume you know the 5 characters that you need to replace (this forum did not allow me to post them as it generated an error)?

I've found articles that mention using BCP to export an XML resultset to a file.

"The universe is complicated and for the most part beyond your control, but your life is only as complicated as you choose it to be."
Post #1294663
Posted Thursday, May 3, 2012 8:53 AM



Group: General Forum Members
Last Login: Monday, August 29, 2016 1:09 PM
Points: 13,999, Visits: 9,728
I've been using XML in various database-related solutions for several years. Started with SQL 2005, really.

The main problem I've run into with it has been very, very poor documentation. The SQL Server XQuery documentation started out being worse than useless when I first needed to dig into it. Circular definitions, lack of examples, examples that didn't actually work, and a writing style that assumed you already knew everything there was to know about XML and just need the specifics to Microsoft's implementation of XQuery functions.

The W3C documentation on XML largely assumes you already know everything about XML and are looking to compare implementations to standards, not looking to figure out what the heck the standards mean in the first place.

I think a lot of the problem with XML is that its been documented by people who are very good at getting computers to communicate with each other, but who haven't the faintest clue of how to communicate with other people. Hate to say that, but it really feels like that.

Over the years since I first started dealing with it, I've noticed the documentation has improved steadily in quality, and in quantity. It's a lot easier to find what I need these days than when I started with it.

But it still very much depends on already knowing the subject pretty well before you can even search for answers. If you don't know the term "nodes function", you really can't Google/Bing/whatever "how do I separate rows of XML into rows of tabular data" and get anything that will help you out. Try both searches, see what you get.

It's moved from "you have to be an expert to even ask a question" to "you have to know some of the terminology before you can ask a question". That's a huge improvement, but it's still got a ways to go.

Where I'm at? I know XML in SQL Server well enough to solve some interesting problems in efficient ways, but it's not as easy as it should be.

Property of The Thread

"Nobody knows the age of the human race, but everyone agrees it's old enough to know better." - Anon
Post #1294671
Posted Thursday, May 3, 2012 8:53 AM
Old Hand

Old HandOld HandOld HandOld HandOld HandOld HandOld HandOld Hand

Group: General Forum Members
Last Login: Monday, November 28, 2016 12:02 PM
Points: 379, Visits: 2,546
Eric M Russell (5/3/2012)
I've found articles that mention using BCP to export an XML resultset to a file.

I know of bcp, and it is (convenience wise) for export a far cry from what BULK INSERT is in T-SQL for imports.
Post #1294672
Posted Thursday, May 3, 2012 8:59 AM

UDP Broadcaster

UDP BroadcasterUDP BroadcasterUDP BroadcasterUDP BroadcasterUDP BroadcasterUDP BroadcasterUDP BroadcasterUDP Broadcaster

Group: General Forum Members
Last Login: Wednesday, October 19, 2016 12:41 PM
Points: 1,447, Visits: 3,254
I think XML has its place but it has been over-hyped and inappropriately used in various situations.

The product requirements should clearly indicate that using XML (for whatever purpose) is advantageous or necessary.

The probability of survival is inversely proportional to the angle of arrival.
Post #1294681
Posted Thursday, May 3, 2012 11:19 AM

Ten Centuries

Ten CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen CenturiesTen Centuries

Group: General Forum Members
Last Login: Tuesday, September 16, 2014 2:03 PM
Points: 1,334, Visits: 3,069
I agree Steve, that if you are currently a DBA, it is only going to benefit you to know XML not just only now, but also definitely down the road as well. I live in Miami/Fort Lauderdale and for the same exact reasons it definitely benefits me now, as well as in the future, to learn Spanish.

"Technology is a weird thing. It brings you great gifts with one hand, and it stabs you in the back with the other. ..."
Post #1294827
« Prev Topic | Next Topic »

Add to briefcase ««12

Permissions Expand / Collapse