Some of you may be BLOCKING googlebots IP without even knowing. - GoFuckYourself.com

Murderous · 12-22-2007, 08:05 AM

I have been wondering why my sitemaps were coming up unreachable by googlebot in googles webmaster tools. Apparently the colonical links in WP 2.3 is causing some hosts to block googlebots IP caused by multiple connections. Many hosts are setup with a low threshhold for concurrent visits.

Here is more info:
http://www.homewithandrew.com/index....achable-error/

The first few sections of that article are mostly the guy rambling on, but the juice is further into it and in the comments.

I know I was pretty happy to find out that wordpress 2.3 with the colonical links would help further feed the bot, while saving your ass from getting flagged for dupe. Sucks that most hosts are unaware of this until it is pointed out to them.

You could be losing traffic due to this. I know I am/was.

This is from the last commentor on that page:
some web hosts set a low threshold for concurrent visits by the same bot to prevent abuse. In fact, many website owners ARE experiencing this problem but don?t even realize it! They just chalk it up to ?being penalized? by Google

WTF?

Just thought it might help some of you.

12-22-2007, 08:05 AM	#1
Murderous Confirmed User Join Date: Oct 2003 Location: Pennsylvania Posts: 3,938	Some of you may be BLOCKING googlebots IP without even knowing. I have been wondering why my sitemaps were coming up unreachable by googlebot in googles webmaster tools. Apparently the colonical links in WP 2.3 is causing some hosts to block googlebots IP caused by multiple connections. Many hosts are setup with a low threshhold for concurrent visits. Here is more info: http://www.homewithandrew.com/index....achable-error/ The first few sections of that article are mostly the guy rambling on, but the juice is further into it and in the comments. I know I was pretty happy to find out that wordpress 2.3 with the colonical links would help further feed the bot, while saving your ass from getting flagged for dupe. Sucks that most hosts are unaware of this until it is pointed out to them. You could be losing traffic due to this. I know I am/was. This is from the last commentor on that page: some web hosts set a low threshold for concurrent visits by the same bot to prevent abuse. In fact, many website owners ARE experiencing this problem but don?t even realize it! They just chalk it up to ?being penalized? by Google WTF? Just thought it might help some of you.