|
|
|
|
||||
|
Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums. You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today! If you have any problems with the registration process or your account login, please contact us. |
 |
|
|||||||
| Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed. |
|
|
Thread Tools |
07-19-2004, 12:11 AM
|
#1 |
|
Registered User
Join Date: Apr 2001
Posts: 78
|
Script to crawl for listed galleries on TGPs??
Rather than checking each TGP to see if you're listed, is there a script to do that?? The script would crawl specific TGPs for your domains and send alerts if your domain is there.
And would doing so be ok with TGP owners?? |
|
|
|
07-19-2004, 12:12 AM
|
#2 |
|
Confirmed User
Join Date: Jun 2002
Location: austin, tx
Posts: 1,911
|
easy enough to write in perl. just a script that screen scrapes and does compares.
__________________
http://www.flickr.com/photos/zoddler/ |
|
|
|
|
07-19-2004, 12:13 AM
|
#3 |
|
congrats to the winners
Industry Role:
Join Date: Nov 2001
Location: Echo Beach
Posts: 10,891
|
im gonna have to blacklist you for that suggestion....
|
|
|
|
|
07-19-2004, 12:29 AM
|
#4 | |
|
Confirmed User
Industry Role:
Join Date: Dec 2002
Location: Behind the scenes
Posts: 5,190
|
Quote:
__________________
|
|
|
|
|
|
07-19-2004, 12:31 AM
|
#5 | |
|
congrats to the winners
Industry Role:
Join Date: Nov 2001
Location: Echo Beach
Posts: 10,891
|
Quote:
|
|
|
|
|
|
07-19-2004, 12:31 AM
|
#6 |
|
Confirmed User
Join Date: May 2001
Posts: 5,335
|
__________________
ReliableServers.com - NO REF LINK! |
|
|
|
|
07-19-2004, 12:33 AM
|
#7 | |
|
Confirmed User
Join Date: Jun 2002
Location: austin, tx
Posts: 1,911
|
Quote:
__________________
http://www.flickr.com/photos/zoddler/ |
|
|
|
|
|
07-19-2004, 12:34 AM
|
#8 | |
|
Confirmed User
Join Date: Jan 2003
Posts: 3,852
|
Quote:
|
|
|
|
|
|
07-19-2004, 12:43 AM
|
#9 | |
|
Confirmed User
Industry Role:
Join Date: Dec 2002
Location: Behind the scenes
Posts: 5,190
|
Quote:
i'd recommend instead of investing into crawler just get real time stats of your own server, lol, i hope i'm not getting banned for this 
__________________
|
|
|
|
|
|
07-19-2004, 12:56 AM
|
#10 |
|
Confirmed User
Join Date: Jul 2002
Location: Magrathea
Posts: 6,493
|
Here are some screen captures from a script I wrote to do this. It's a couple of years old, now, but if there is enough interest, I might polish it up and release it.
    SpaceAce |
|
|
|
|
07-19-2004, 01:11 AM
|
#11 | |
|
congrats to the winners
Industry Role:
Join Date: Nov 2001
Location: Echo Beach
Posts: 10,891
|
Quote:
99% of our site is/are partner submits so they know they are listed.. |
|
|
|
|
