|
I add this to all of my sites' robots.txt :
User-agent: ia_archiver
Disallow: /
that keeps archive.org from spidering and keeping a copy of your site forever
__________________
__________________
Looking for a custom TUBE SCRIPT that supports massive traffic, load balancing, billing support, and h264 encoding? Hit up Konrad!
Looking for designs for your websites or custom tubesite design? Hit up Zuzana Designs
Check out the #1 WordPress SEO Plugin: CyberSEO Suite
|