Quote:
Originally posted by DarkJedi
isn't coming up with robots.txt exuse like telling a person to lock his house so it doesnt get robbed ?
|
No. Having a house doesn't imply wanting complete and utter strangers to run all over it. Putting up a website, however, does imply wanting complete and utter strangers to visit it. In houses, being private is the standard, on the internet, being public is the standard.