I'm not touching this shit with a 10 foot pole, but I want to know what type of developer I want to be looking for. Will be fetching/scraping a large amount of data from multiple sources for SEO research. Needs to support a large proxy list and multi-threading to accomplish my goals. Will probably need to perform between 180-250k requests daily...
|