Quote:
Originally posted by DarkJedi
ok, i want people visiting my site.
but i dont want nobody stealing my content and links.
I could make some script and let it spider Hun for his links and then just tell Hun to install robots.txt
|
That's *copying* the database of a *specific* site.
However, if you were to spider The Hun and a whole bunch of other sites, would honor robots.txt and robots metatags, and would rank all of them by a unique algorithm you would most likely be in the clear.
Links in general are not seen as private. You could equate them to roads irl - anyone can map them if he wants, unless someone puts up a sign "private road".