Re: [xml-dev] What is the general direction you are seeing these days to

[Michael Kay <mike@saxonica.com>]

> As always Michael, you are very wise. And I certainly appreciate your graciousness.
> 
> I have some figures regarding size and complexity:
> 
> 	There are 50 million XML files, each 50MB in size. 
> 	The files are mostly flat (not deeply nested). 
> 	We need to perform queries across the 50 million files.
> 
> What's your recommendation for storing and querying this huge amount of XML files?
> 

Depends on project timescales, budget and risk, and possibly on availability of expertise and experience in particular technologies. Probably one of the following alternatives:

(A) Start a prototyping project to assess whether MarkLogic is capable of meeting the project requirements.

(B) Choose three native XML databases that look promising and assess each of the three to compare how well they handle the project requirements.

Michael Kay
Saxonica