View Single Post
Old 11-10-2010, 01:56 AM  
Angry Jew Cat - Banned for Life
(felis madjewicus)
 
Industry Role:
Join Date: Jul 2006
Location: In Mom & Dad's Basement
Posts: 20,368
Retrieving PR for domains in a large list?

Say I want to process the corresponding PageRank for each in a large list of domains. How do I go about processing say 100k pages in a day? I've looked over some PHP classes for retrieving PR, but can they process that number of requests in a day? It seems like Google would bitchslap my IP for doing this. But then again I've got desktop apps that will burn through like 30k domains and retrieve PR for me with no huge hangups. How are they doing it?
Angry Jew Cat - Banned for Life is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote