RE: [xml-dev] What is the general direction you are seeing thesedays to

["Costello, Roger L." <costello@mitre.org>]

> Do you need full text querying? XPath?

The queries are done using XPath and XQuery.

> Do you know or care what the document vocabularies are?

The XML elements and attributes are very well known. The structure of the XML is well known.

/Roger

-----Original Message-----
From: Michael Sokolov [mailto:msokolov@safaribooksonline.com] 
Sent: Thursday, March 05, 2015 11:37 AM
To: Costello, Roger L.; xml-dev@lists.xml.org
Subject: Re: [xml-dev] What is the general direction you are seeing these days to store and query lots of large complex XML?

One critical factor to consider is what kind of queries you will need to 
perform, and how much knowledge of the document structure will be 
encoded in the queries.

Do you need full text querying? XPath? Do you know or care what the 
document vocabularies are?

-Mike

On 3/5/15 10:26 AM, Costello, Roger L. wrote:
> As always Michael, you are very wise. And I certainly appreciate your graciousness.
>
> I have some figures regarding size and complexity:
>
> 	There are 50 million XML files, each 50MB in size.
> 	The files are mostly flat (not deeply nested).
> 	We need to perform queries across the 50 million files.
>
> What's your recommendation for storing and querying this huge amount of XML files?
>
> /Roger
>
>
> _______________________________________________________________________
>
> XML-DEV is a publicly archived, unmoderated list hosted by OASIS
> to support XML implementation and development. To minimize
> spam in the archives, you must subscribe before posting.
>
> [Un]Subscribe/change address: http://www.oasis-open.org/mlmanage/
> Or unsubscribe: xml-dev-unsubscribe@lists.xml.org
> subscribe: xml-dev-subscribe@lists.xml.org
> List archive: http://lists.xml.org/archives/xml-dev/
> List Guidelines: http://www.oasis-open.org/maillists/guidelines.php