Caffeine spiders my Mainstream sites in seconds
 

During the last few months, I noticed that caffeine spiders my Mainstream sites in a matter of seconds... Man, my last post was cached in 10 seconds by google! Then I type the title of the post in Google and there I am! In the first positions with "1 minute ago"! Amazing! And yes, it gets SE traffic if you ask that.

I don't notice the same with my adult sites though, even older adult established sites don't get spidered this fast, like my mainstream sites. Another great reason to switch over to Mainstream.

.

I have two social networks and have noticed that the Google bot never leaves. Ever.

How could G consistently find new posts within 10 seconds unless it's repeatedly hammering a site? Imagine if all SE bots went fishing like that!

I kind of have the opposite problem, there's too much content for it to ever completely index so it just fetches endlessly, more than 120,000+ per day...

How much band does google takes that way ??!?

What script/software are you using for your social bookmarking sites?

Google = Evil

and seriously it's really worrying that there is something like Google owned by god knows who and with no serious alternatives...

I'm wondering if google uses its never-ending cookie on people's computers to tell it when new content is viewed and should be spidered?