Thread: sphider search script?
View Single Post
Old 06-25-2011, 10:23 PM  
AdultKing
Raise Your Weapon
 
AdultKing's Avatar
 
Industry Role:
Join Date: Jun 2003
Location: Outback Australia
Posts: 15,605
No it would not handle 30 million web pages, at an average 2 seconds to crawl one page you'd be waiting a while.
AdultKing is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote