Processing huge XML files

[Thomas Lee <ytlee@cecid.hku.hk>]

Hi all,

We need to process very large XML files (up to a few ten MB). So we 
can't process the whole file with DOM in memory. We are prepared to use 
SAX to parse a large XML file and store into our data structure in the 
disk (propietary data structure or RDBMS). We'll also provide a set of 
APIs for access the contents in the XML file. Now the XML content change 
is not required.

However, instead of developing a customized solution, I'd like to know 
if there is any existing tools and library handling large XML files in disk.

Regards,
Thomas

-- 
   Thomas Y.T. LEE
   Chief Technology Officer
   Center for E-Commerce Infrastructure Development (CECID)
   Department of Computer Science and Information Systems
   The University of Hong Kong
   E-mail: ytlee@cecid.hku.hk  URL: http://www.cecid.hku.hk
   Tel: +852 22415388  Fax: +852 25474611
   Room 301, Chow Yei Ching Building
   Pokfulam Road, Hong Kong SAR, China