GoFuckYourself.com - Adult Webmaster Forum - View Single Post

qw12er · 12-26-2007, 07:57 PM

I'm trying to make a data warehouse with all the FHGs out there and I'm having an hard time building a system to gather all those infos.

Some sponsors have csv export witch are good for one time update but requires manual interaction for each update.

Then some sponsors have the RSS feed which contain too less galleries to import (On most sponsors)

I though of building a spyder but it's a lot of work and some FHG are protected againt that kind of bot.

So am I missing an easy way to gather all those FHGs ? What would be the best way to do so ?

12-26-2007, 07:57 PM
qw12er Confirmed User Join Date: Apr 2004 Location: Montreal Posts: 799	FHG producer please read. I'm trying to make a data warehouse with all the FHGs out there and I'm having an hard time building a system to gather all those infos. Some sponsors have csv export witch are good for one time update but requires manual interaction for each update. Then some sponsors have the RSS feed which contain too less galleries to import (On most sponsors) I though of building a spyder but it's a lot of work and some FHG are protected againt that kind of bot. So am I missing an easy way to gather all those FHGs ? What would be the best way to do so ? __________________ I have nothing to advertise ... yet.