Re: [xml-dev] Re: ***SPAM*** [xml-dev] Re: The Goals of XML at 25,and th

[Rick Jelliffe <rjelliffe@allette.com.au>]

On Fri, 23 Jul. 2021, 01:41 Peter Flynn, <peter@silmaril.ie> wrote:

>.  It seems to
> implicitly assume that the entirety of the source document is already
> available,

Which in the document field (eg Humanities encoded texts, books,
articles in journals, etc) is almost certainly true.

SIMD parallel operations don't care whether the document is all there.

I think there is a connection with streaming in some cases of parallelism. 

For example, lets say you have a huge document over a slow net, and your processing scenario is to parallel lex the documents using an NVIDIA GPU, which lets you run 20,000 threads at the same time, in synced groups of 32 threads and then use a conventional multi-core CPU to do the parse.  

 But you do need to corordinate the running of the thread groups with the availability of the data. If you wait till the last packet arrives before starting the lexing or parsing, you may need a lot of good parallelism before you can reduce latency.  (But if you are on an uncongested server and your interest is highest throughput rather than lowest latency, the parallel approaches can still useful inasmuchas they can harness all the available cores. )

Rick