GoFuckYourself.com - Adult Webmaster Forum

GoFuckYourself.com - Adult Webmaster Forum (https://gfy.com/index.php)
-   Fucking Around & Business Discussion (https://gfy.com/forumdisplay.php?f=26)
-   -   How many IPs does google bot hit you with per day? (https://gfy.com/showthread.php?t=1010345)

blackmonsters 02-14-2011 03:46 PM

How many IPs does google bot hit you with per day?
 
I'm getting multiple IPs hits from google bot.
I haven't check them all but I think I see at least 20 IPs.

Is it all SE bots or is this other google apps showing up as SE bots?

Disclaimer : Yes, I can check all the user agents and find out myself but if
you already know the answer then just tell me OK. :1orglaugh

KillerK 02-14-2011 04:50 PM

Good question, why do they need to hit you so many times too.

Maybe once a day would be ok, unless you actually had fresh content each time they showed up.

blackmonsters 02-14-2011 05:01 PM

Quote:

Originally Posted by KillerK (Post 17915463)
Good question, why do they need to hit you so many times too.

Maybe once a day would be ok, unless you actually had fresh content each time they showed up.

My content rotates, so it can be seen as fresh every time they visit but I don't
know if that's true.

By the way MSN bot is actually hitting me more times and with multiple IPs.

Chosen 02-14-2011 09:20 PM

I'm not counting...

jigg 02-15-2011 07:54 PM

3 the last time i checked and it kills my VPS when it happens

blackmonsters 02-15-2011 08:16 PM

Quote:

Originally Posted by jigg (Post 17918114)
3 the last time i checked and it kills my VPS when it happens

My server handles all the bot hits without me noticing.

I just hate looking at my stats when my biggest surfers every day are
5 massive SE bots. :(

I shouldn't say shit about google, because the baidu spider crawls 35,000 pages. :1orglaugh

My stats show exactly one hit from baidu search.
That hit was probably the "bot master" testing to see if my site was still up after they
crawled it to smithereens. :1orglaugh


Disclaimer : Baidu = China = Me blocked.

rowan 02-16-2011 06:39 AM

This is over approximately 3 days and 120,000 googlebot fetches

66.249.67.141
66.249.67.143
66.249.67.176
66.249.67.178
66.249.68.129
66.249.68.131
66.249.68.132
66.249.68.134
66.249.68.169
66.249.68.184
66.249.68.201
66.249.68.249
66.249.68.251
66.249.71.120
66.249.71.148
66.249.71.181
66.249.72.104
66.249.72.105
66.249.72.122
66.249.72.123
66.249.72.14
66.249.72.15
66.249.72.163
66.249.72.2
66.249.72.218
66.249.72.219
66.249.72.3
66.249.72.67
66.249.72.69
66.249.72.70


All times are GMT -7. The time now is 09:24 AM.

Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2025, vBulletin Solutions, Inc.
©2000-, AI Media Network Inc