[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
RE: [xml-dev] XML Database Decision Tree?
- From: Eric Lemond <firstname.lastname@example.org>
- To: Lorne Harwood <email@example.com>
- Date: Thu, 01 Nov 2001 14:12:13 -0700
The load speed we see is generally between 50K to 250K per second per
thread. The person who loaded GenBank is on vacation, so I don't have
an exact load time. The exact load rate will vary based on the size of
the docs, memory and system configuration. Keep in mind that the rate
includes the equivalent of full indexing. Wish I could give you
specifics, but I hope this is helpful.
From: Lorne Harwood [mailto:firstname.lastname@example.org]
Sent: Thursday, November 01, 2001 1:10 PM
To: Eric Lemond
Subject: RE: [xml-dev] XML Database Decision Tree?
How long did it take to load/index the 44.GB?
I can give a real example of loading data into NeoCore XMS. This was a
project one of our engineers did to prove that we could handle huge data
sets. It's not meant as a benchmark, but to illustrate data loading
We got a copy of the 44.1 GB GenBank of genomics research. We converted
the documents to XML with a small Perl script. Each document is an
average of 200 MB in size.
Using the command: neoxmlutils import [config dir location] [import
The resulting database footprint was 34.4 GB (<80% the size of the
original data). You don't have to create any indexes. With our pattern
processing technology, the database is fully indexed.
Just wanted to confirm how easy it is to load data into an XML Database.
Get your FREE download of MSN Explorer at