OASIS Mailing List ArchivesView the OASIS mailing list archive below
or browse/search using MarkMail.


Help: OASIS Mailing Lists Help | MarkMail Help



   RE: [xml-dev] Processing huge XML files

[ Lists Home | Date Index | Thread Index ]

> We need to process very large XML files (up to a few ten MB). So we 
> can't process the whole file with DOM in memory. We are 
> prepared to use 
> SAX to parse a large XML file and store into our data 
> structure in the 
> disk (propietary data structure or RDBMS). We'll also provide 
> a set of 
> APIs for access the contents in the XML file. Now the XML 
> content change 
> is not required.
> However, instead of developing a customized solution, I'd 
> like to know 
> if there is any existing tools and library handling large XML 
> files in disk.

Actually, a few tens of megabytes is not that huge: I've heard of people
using Saxon to transform 100Mb files successfully, though it's certainly
not easy.

But really, when you get above 50Mb or so, you need to start looking at
XML databases. And I'm not saying that only because my company sells one

Michael Kay
Software AG
home: Michael.H.Kay@ntlworld.com
work: Michael.Kay@softwareag.com 

[1] http://www.softwareag.com/tamino/


News | XML in Industry | Calendar | XML Registry
Marketplace | Resources | MyXML.org | Sponsors | Privacy Statement

Copyright 2001 XML.org. This site is hosted by OASIS