[
Lists Home |
Date Index |
Thread Index
]
> Paul T wrote:
>
>
> So, what HGRAB actually does? It polls
> the HTML pages ( once in a while,
> no harm done to the load of original
> website ). Then it places some part of the
> content into HGRAB database (for future
> searching). Then it provides the end-user
> with some 'part' of the original news item
> and with the URL to the original news source.
>
> Google does *exactly* this (and also Google
> provides a cached copy of the original content)
>
> That means:
>
> Either both HGRAB and Google should be sued,
> because they both sell the content
> *which does not belong to them*, or both
> HGRAB and Google should be considered
> 'just a service'.
Have a look at http://www.google.com/robots.txt
Ari.
|
