Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums.

You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today!

If you have any problems with the registration process or your account login, please contact us.

Post New Thread Reply

Register GFY Rules Calendar Mark Forums Read
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >
Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed.

 
Thread Tools
Old 02-14-2011, 03:46 PM   #1
blackmonsters
Making PHP work
 
blackmonsters's Avatar
 
Industry Role:
Join Date: Nov 2002
Location: 🌎🌅🌈🌇
Posts: 20,227
How many IPs does google bot hit you with per day?

I'm getting multiple IPs hits from google bot.
I haven't check them all but I think I see at least 20 IPs.

Is it all SE bots or is this other google apps showing up as SE bots?

Disclaimer : Yes, I can check all the user agents and find out myself but if
you already know the answer then just tell me OK.
__________________
Make Money with Porn
blackmonsters is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 02-14-2011, 04:50 PM   #2
KillerK
Confirmed User
 
Join Date: May 2008
Posts: 3,406
Good question, why do they need to hit you so many times too.

Maybe once a day would be ok, unless you actually had fresh content each time they showed up.
KillerK is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 02-14-2011, 05:01 PM   #3
blackmonsters
Making PHP work
 
blackmonsters's Avatar
 
Industry Role:
Join Date: Nov 2002
Location: 🌎🌅🌈🌇
Posts: 20,227
Quote:
Originally Posted by KillerK View Post
Good question, why do they need to hit you so many times too.

Maybe once a day would be ok, unless you actually had fresh content each time they showed up.
My content rotates, so it can be seen as fresh every time they visit but I don't
know if that's true.

By the way MSN bot is actually hitting me more times and with multiple IPs.
__________________
Make Money with Porn
blackmonsters is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 02-14-2011, 09:20 PM   #4
Chosen
 
Industry Role:
Join Date: Aug 2001
Posts: 63,151
I'm not counting...
Chosen is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 02-15-2011, 07:54 PM   #5
jigg
Confirmed User
 
Join Date: Feb 2002
Posts: 2,527
3 the last time i checked and it kills my VPS when it happens
__________________
......
eight,eight,two,eight,eight,four,two
......
jigg is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 02-15-2011, 08:16 PM   #6
blackmonsters
Making PHP work
 
blackmonsters's Avatar
 
Industry Role:
Join Date: Nov 2002
Location: 🌎🌅🌈🌇
Posts: 20,227
Quote:
Originally Posted by jigg View Post
3 the last time i checked and it kills my VPS when it happens
My server handles all the bot hits without me noticing.

I just hate looking at my stats when my biggest surfers every day are
5 massive SE bots.

I shouldn't say shit about google, because the baidu spider crawls 35,000 pages.

My stats show exactly one hit from baidu search.
That hit was probably the "bot master" testing to see if my site was still up after they
crawled it to smithereens.


Disclaimer : Baidu = China = Me blocked.
__________________
Make Money with Porn
blackmonsters is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 02-16-2011, 06:39 AM   #7
rowan
Too lazy to set a custom title
 
Join Date: Mar 2002
Location: Australia
Posts: 17,393
This is over approximately 3 days and 120,000 googlebot fetches

66.249.67.141
66.249.67.143
66.249.67.176
66.249.67.178
66.249.68.129
66.249.68.131
66.249.68.132
66.249.68.134
66.249.68.169
66.249.68.184
66.249.68.201
66.249.68.249
66.249.68.251
66.249.71.120
66.249.71.148
66.249.71.181
66.249.72.104
66.249.72.105
66.249.72.122
66.249.72.123
66.249.72.14
66.249.72.15
66.249.72.163
66.249.72.2
66.249.72.218
66.249.72.219
66.249.72.3
66.249.72.67
66.249.72.69
66.249.72.70
rowan is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Post New Thread Reply
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >

Bookmarks
Thread Tools



Advertising inquiries - marketing at gfy dot com

Contact Admin - Advertise - GFY Rules - Top

©2000-, AI Media Network Inc



Powered by vBulletin
Copyright © 2000- Jelsoft Enterprises Limited.