Re: [xml-dev] HGRAB. Syndication. Google. Grey area.

From
K. Ari Krupnikov <>
To
Paul T <>
Date
2002-01-08T22:22:44Z
ID
<>
Thread
Re: [xml-dev] HGRAB. Syndication. Google. Grey area.
> Paul T wrote:
> 
> 
> So, what HGRAB actually does? It polls
> the HTML pages ( once in a while,
> no harm done to the load of original
> website ). Then it places some part of the
> content into HGRAB database (for future
> searching). Then it provides the end-user
> with some 'part' of the original news item
> and with the URL to the original news source.
> 
> Google does *exactly* this (and also Google
> provides a cached copy of the original content)
> 
> That means:
> 
> Either both HGRAB and Google should be sued,
> because they both sell the content
> *which does not belong to them*, or both
> HGRAB and Google should be considered
> 'just a service'.


Have a look at http://www.google.com/robots.txt

Ari.