My site keeps getting hits from googlebot, how do i make it stop? - GoFuckYourself.com

pr0phet · 01-16-2005, 05:40 PM

I get hit by googlebot 4-5 times a day. It eats up so much bandwidth!!!

I asked people on a mainstream forum and they told me its because I somehow have a pr6. I dont even know what that means. Anyone can help?

ProjectNaked · 01-16-2005, 05:45 PM

if you ask him nicely he will go away....if that deosn't work, try *******...it scares away everyone

Yug · 01-16-2005, 06:17 PM

put in a robots.txt file in your root directory.

In it, specify the directories or files you dont want the spiders to access:

for example, if u dont want spiders accessing any files in your site named 'email.htm' u would put:

Disallow: email.htm

if you dont want spiders accessing any specific folders, like the cgi-bin folder for example, u would put:

Disallow: /cgi-bin/

And last of all, if you have a pr of 6, what is the website URL? I think you should put a link to my site on it for helping you out

prezzz · 01-16-2005, 06:47 PM

PR 6 means that your site sucks (PR stands for Professionality Rating
and the number is between 0 and 10,000 which means your site is not
that good at all). Care to sell the domain? I'll pay the transfer rates
and throw in additional 10 bucks to cover your costs.

pornguy · 01-16-2005, 06:57 PM

prezzz it is nice of you to help him out like that, and I would oals like to help by offering to take that domain from you before it brings down any others. I will top the offer by prezzz by 20$

Furious_Male · 01-16-2005, 06:59 PM

Google bot and those pesky porn surfers that like to sign up for sites piss me off too.

Basic_man · 01-16-2005, 07:01 PM

Quote:

Originally Posted by prezzz

PR 6 means that your site sucks (PR stands for Professionality Rating
and the number is between 0 and 10,000 which means your site is not
that good at all). Care to sell the domain? I'll pay the transfer rates
and throw in additional 10 bucks to cover your costs.

lolol I'm sure you would like to have a PR6 site :D

dcortez · 01-16-2005, 07:02 PM

http://www.google.com/webmasters/3.html#B3

-Dino

r3ap3r · 01-16-2005, 07:04 PM

Googlebots are your friends. Welcome them with open arms.

Jace · 01-16-2005, 07:10 PM

sometimes I wonder how you all fall for this shit so often

TheMob · 01-16-2005, 08:21 PM

Quote:

Originally Posted by JaceXXX

sometimes I wonder how you all fall for this shit so often

my thoughts.. it's mind boggling

rowan · 01-16-2005, 09:01 PM

Quote:

Originally Posted by r3ap3r

Googlebots are your friends. Welcome them with open arms.

We don't need no steenking google hit bots!@$^!!*@!

misty_dayz · 01-16-2005, 09:12 PM

Helpful Hint:
Really stupid question by someone with a post count under 10 = not a real question, it is someone having fun

QuaWee · 01-16-2005, 09:14 PM

block him using editing your .htaccess

fünkmaster · 01-16-2005, 09:33 PM

... I blocked MSN bot, I think everyone should.

pudcat · 01-16-2005, 11:41 PM

Quote:

Originally Posted by JaceXXX

sometimes I wonder how you all fall for this shit so often

01-16-2005, 05:40 PM	#1
pr0phet Confirmed User Industry Role: Join Date: Jan 2005 Posts: 1,041	My site keeps getting hits from googlebot, how do i make it stop? I get hit by googlebot 4-5 times a day. It eats up so much bandwidth!!! I asked people on a mainstream forum and they told me its because I somehow have a pr6. I dont even know what that means. Anyone can help? __________________ Pr0phet

01-16-2005, 06:17 PM	#3
Yug Confirmed User Join Date: Dec 2002 Location: Brisbane, Australia Posts: 218	put in a robots.txt file in your root directory. In it, specify the directories or files you dont want the spiders to access: for example, if u dont want spiders accessing any files in your site named 'email.htm' u would put: Disallow: email.htm if you dont want spiders accessing any specific folders, like the cgi-bin folder for example, u would put: Disallow: /cgi-bin/ And last of all, if you have a pr of 6, what is the website URL? I think you should put a link to my site on it for helping you out __________________ YugSTAR.com The online cartoon about the adult internet industry

01-16-2005, 06:57 PM	#5
pornguy Too lazy to set a custom title Industry Role: Join Date: Mar 2003 Location: Homeless Posts: 62,911	prezzz it is nice of you to help him out like that, and I would oals like to help by offering to take that domain from you before it brings down any others. I will top the offer by prezzz by 20$ __________________ PornGuy skype me pornguy_epic AmateurDough The Hottes Shemales online! TChicks.com \| Angeles Cid \| Mariana Cordoba \| MAILERS WELCOME!

01-16-2005, 06:59 PM	#6
Furious_Male Doing the grind since 99 Industry Role: Join Date: Oct 2003 Location: Buffalo NY Posts: 16,881	Google bot and those pesky porn surfers that like to sign up for sites piss me off too. __________________ Living in Virtual Reality Contact: Email (preferred): furiousmale .at. gmail - Skype: live:shanedws

01-16-2005, 07:04 PM	#9
r3ap3r Confirmed User Join Date: Jul 2004 Location: Canada Posts: 3,535	Googlebots are your friends. Welcome them with open arms. __________________ Fuck My Sig Good ICQ - 203744959

01-16-2005, 05:45 PM	#2
ProjectNaked Confirmed User Join Date: Jul 2004 Location: Detroit Areola Posts: 4,309	if you ask him nicely he will go away....if that deosn't work, try *******...it scares away everyone

01-16-2005, 06:47 PM	#4
prezzz Confirmed User Industry Role: Join Date: Jul 2004 Posts: 959	PR 6 means that your site sucks (PR stands for Professionality Rating and the number is between 0 and 10,000 which means your site is not that good at all). Care to sell the domain? I'll pay the transfer rates and throw in additional 10 bucks to cover your costs.

01-16-2005, 07:02 PM	#8
dcortez DINO CORTEZ™ Industry Role: Join Date: Jun 2003 Location: Vancouver Island Posts: 2,145	http://www.google.com/webmasters/3.html#B3 -Dino

01-16-2005, 07:10 PM	#10
Jace FBOP Class Of 2013 Industry Role: Join Date: Jan 2004 Location: bumfuck, ky Posts: 35,562	sometimes I wonder how you all fall for this shit so often

01-16-2005, 09:12 PM	#13
misty_dayz Confirmed User Join Date: Jun 2004 Location: The bank with all the cash Posts: 475	Helpful Hint: Really stupid question by someone with a post count under 10 = not a real question, it is someone having fun

01-16-2005, 09:14 PM	#14
QuaWee Confirmed User Join Date: Jul 2004 Location: boogers Posts: 5,791	block him using editing your .htaccess __________________ i luv mainstream

01-16-2005, 09:33 PM	#15
fünkmaster So Fucking Banned Join Date: Nov 2004 Posts: 791	... I blocked MSN bot, I think everyone should.