Quote:
Originally Posted by CYF
I always add an empty one just so i don't have to see the error messages :-)
|
So you are saying that robots.txt is not helping anything (except that you stop seeing that error message)?
Conclusion that robots.txt should be only used when you need to disallow something? And if you do not want to disallow something there is ZERO point of using it (except that error message)?