I've figured it out... that pilcrow isn't in the list of allowed characters in XML:

http://www.w3.org/TR/2006/REC-xml-20060816/#charsets

Char ::= #x9 | #xA | #xD | [#x20-#xD7FF] | [#xE000-#xFFFD] |...