OASIS Mailing List ArchivesView the OASIS mailing list archive below
or browse/search using MarkMail.

 


Help: OASIS Mailing Lists Help | MarkMail Help

 


 

   Re: [xml-dev] Detection of non-Unicode characters

[ Lists Home | Date Index | Thread Index ]

On Fri, Aug 23, 2002 at 02:24:51PM -0700, Tim Bray wrote:
> Mark Feblowitz wrote:
> >We've gotten ourselves in a slight muddle. We've copied Word documentation
> >into (many) xs:annotation blocks in our UTF-8 .xsd files (there are around
> >300 files). In the process, we have apparently brought along some
> >non-Unicode characters. This is not tolerated equally well by all tools.
> 
> Second possible problem is that the UTF-8 is good but it encodes Unicode 
> characters that aren't allowed in XML, like for example  - any 
> decent XML parser should catch this and give you helpful error messages, 
> if you have an expat around your system (and a lot of people do these 
> days) "xmlwf [filename here]" will do the trick.  D'oh, now that I think 
> about it in fact I bet xmlwf (or equivalent) would probably catch the 
> UTF8 breakage too.  -Tim

I would bet it's this. Just this past week I have been debugging a
broken application that is supposed to generate XML from Word documents.
The main problem I found was that the Word documents are full of
characters like 0x07, 0x2012-0x2019, and the like. The latter range
consists of common punctuation symbols like dashes and left and right
quotes (AKA 'smart quotes'). They appear to be using Code Page 1252
mapped directly into Unicode.

P.S. Why are those punctuation symbols illegal in XML, anyway?

-- 
Matt Gushee
Englewood, Colorado, USA
mgushee@havenrock.com
http://www.havenrock.com/




 

News | XML in Industry | Calendar | XML Registry
Marketplace | Resources | MyXML.org | Sponsors | Privacy Statement

Copyright 2001 XML.org. This site is hosted by OASIS