XML.orgXML.org
FOCUS AREAS |XML-DEV |XML.org DAILY NEWSLINK |REGISTRY |RESOURCES |ABOUT
OASIS Mailing List ArchivesView the OASIS mailing list archive below
or browse/search using MarkMail.

 


Help: OASIS Mailing Lists Help | MarkMail Help

[Date Prev] | [Thread Prev] | [Thread Next] | [Date Next] -- [Date Index] | [Thread Index]
Re: [xml-dev] What is the general direction you are seeing these daysto store and query lots of large complex XML?

I would be interested to know what have you tried and what learnt from that.

On Thu, Mar 5, 2015 at 3:36 PM, Costello, Roger L. <costello@mitre.org> wrote:

Ø  I smell a rat here... where did you get them from.

 

Hmm, no rat here. Those are actual, real numbers. We deal with big data … real big data.

 

/Roger

 

From: Ihe Onwuka [mailto:ihe.onwuka@gmail.com]
Sent: Thursday, March 05, 2015 10:33 AM
To: Costello, Roger L.
Cc: xml-dev@lists.xml.org
Subject: Re: [xml-dev] What is the general direction you are seeing these days to store and query lots of large complex XML?

 

I smell a rat here... where did you get them from.

 

On Thu, Mar 5, 2015 at 3:26 PM, Costello, Roger L. <costello@mitre.org> wrote:

As always Michael, you are very wise. And I certainly appreciate your graciousness.

I have some figures regarding size and complexity:

        There are 50 million XML files, each 50MB in size.
        The files are mostly flat (not deeply nested).
        We need to perform queries across the 50 million files.

What's your recommendation for storing and querying this huge amount of XML files?

/Roger



_______________________________________________________________________

XML-DEV is a publicly archived, unmoderated list hosted by OASIS
to support XML implementation and development. To minimize
spam in the archives, you must subscribe before posting.

[Un]Subscribe/change address: http://www.oasis-open.org/mlmanage/
Or unsubscribe: xml-dev-unsubscribe@lists.xml.org
subscribe: xml-dev-subscribe@lists.xml.org
List archive: http://lists.xml.org/archives/xml-dev/
List Guidelines: http://www.oasis-open.org/maillists/guidelines.php

 




[Date Prev] | [Thread Prev] | [Thread Next] | [Date Next] -- [Date Index] | [Thread Index]


News | XML in Industry | Calendar | XML Registry
Marketplace | Resources | MyXML.org | Sponsors | Privacy Statement

Copyright 1993-2007 XML.org. This site is hosted by OASIS