Re: HTML scraping

[XML Everywhere <host@xmleverywhere.com>]

http://www.oasis-open.org/cover/publicSW.html

It is possible to write an HTML to XML converter
using an SGML parser, but from my own experience
tweaking is required because there is a lot of
bad HTML out there thanks to Netscape.

Overall, tidy is pretty good but tidy fails
if it finds tags that it doesn't understand, rather
than continuing on with its job gracefully.

----- Original Message -----
From: "Arnaud Sahuguet" <sahuguet@gradient.cis.upenn.edu>
To: "XML-DEV" <xml-dev@lists.xml.org>; "Gul Imran"
<gimran@nortelnetworks.com>
Sent: Saturday, March 24, 2001 2:29 PM
Subject: HTML scraping


> If you want to scrap everything (transforming HTML into XML), then Tidy
> is the right way to go (as mentioned in a previous posting).
>
> If you want to extract only SOME HTML information and map it to XML,
> then you should look at W4F (http://db.cis.upenn.edu/W4F/).
>
> There are a couple of on-line examples that show how to build XML
> gateways that transform on-the-fly HTML into XML. The XML can then be
> used by other applications.
> http://db.cis.upenn.edu/W4F/Examples/XML-Gateway/
>
> There is also an interesting related article in JavaWorld:
> http://www.javaworld.com/javaworld/jw-03-2001/jw-0316-webdb.html
>
> Regards,
>
> Arnaud
>
> ------------------------------------------------------------------
> The xml-dev list is sponsored by XML.org, an initiative of OASIS
> <http://www.oasis-open.org>
>
> The list archives are at http://lists.xml.org/archives/xml-dev/
>
> To unsubscribe from this elist send a message with the single word
> "unsubscribe" in the body to: xml-dev-request@lists.xml.org
>