GoFuckYourself.com - Adult Webmaster Forum

GoFuckYourself.com - Adult Webmaster Forum (https://gfy.com/index.php)
-   Sell and Buy Forum (https://gfy.com/forumdisplay.php?f=35)
-   -   Craigslist Escort Scraper (Get millions of escort listings with pictures) (https://gfy.com/showthread.php?t=904970)

lavitra 05-12-2009 07:30 PM

Craigslist Escort Scraper (Get millions of escort listings with pictures)
 
Get millions of escort listings from craigslist with pictures!

Simply put the cities, you want to collect listings from, and your mysql database will be filled with millions of escort listings with pictures.

Each is categorized into: Title, Description, Link to the Listing, Age of Escort, Image Included?, city, posting date of listing, picture location on local storage.

Pictures are downloaded and stored into a separate folder.

Please contact me (see signature).

Generated Sample:
Code:

INSERT INTO `ad` (`id`, `title`, `description`, `link`, `age`, `has_image`, `city`, `post_time`, `image_link`, `createdon`) VALUES
(624, 'AMAZING MASSEUSES ~~ AMAZING RESULTS!  - w4m', '\n<p>\r\n \r\n<p></p>\r\n<center><font color="blue" size="5">Check out our new asian CMT Amy!</font></center>\r\n<center><font color="blue" size="5"> </center>\r\n<center>FOUNTAIN SPA</center>\r\n<center>817 B 4th Street</center>\r\n<center>San Rafael, CA  94901<br>We''re located on 4th Street between Lincoln and Cijos at 817B 4th Street</center>\r\n<center> </center>\r\n<center>Open from 10am to 11pm</center>\r\n<center>7 days a week</center>\r\n<center>We accept Visa, MasterCard, Discover and American Express</center>\r\n<center> </center>\r\n<center> </center>\r\n<center><br> </center></font></b>\r\n<center></center>\r\n<br><br><font></font>\r\n<table></table>\r\n<p>\n\n\n<br><br>\n\n                \n\n', 'sfbay.craigslist.com/nby/ers/1144629597.html', 22, 1, 'sfbay', '2009-04-28,  1:00PM PDT', '3ma3p73l0ZZZZZZZZZ94s491c7e1e85221dc8.jpg', '2009-04-28 13:26:23'),
(625, '.....WAiTiNG .....WHiTE GiRL ..... READY .....SET .....GO ......... - w4m (mission district)', '\n<center>Are you interested in a no strings attached relationship?<br> Do you desire friendship and romance without all the emotional commitment of a relationship? <br>I offer a full-session, never rushed experience. I am not mechanical, so whether it''s short-but-sweet or a slow-and-sensual, you always get the real me. <br>I am open-minded and mutual satisfaction is always my objective.<br> No need to worry, I provide a very clean and safe IN location, Here in the City of San Francisco.<br> Give me a call, promise it''ll be worth your while.<h2><br>hable muy poco espaņol<br>OUT Meetings are available<br>Call Day, Evening or Night, Its Okay.<br><h4>****PLEASE NOTE**** <br><br>NO EXPLICIT SEXUAL QUESTIONS OVER THE PHONE OR WHEN YOU 7 8923<h6>\n\n\n<br><br>\n\n                \n\n', 'sfbay.craigslist.com/sfc/ers/1144629276.html', 0, 1, 'sfbay', '2009-04-28,  1:00PM PDT', '3k43m13laZZZZZZZZZ94s6f41f2eed540177d.jpg', '2009-04-28 13:26:24'),
(626, '=*__BLONDE =*BEAUTY =*REAL ACTUAL PIC*= - w4m', '\nHey boys! \r<br>\nMy name is Amber \r<br>\nI am 23years old, 5''3 and 13O pounds ,With long BLOnde Hair . \r<br>\nI am looking for a generous gentlemen to spend time with me today at my cozy incall .\r<br>\nNO BLOCKED CALLS OR TEXTS WILL BE ANSWERED! \r<br>\nIll be wait for you... \r<br>\n\r<br>\nQQ 8O\r<br>\nHALF 1OO\r<br>\nHOUR 15O\r<br>\n2 GIRLS 2OO \r<br>\n\r<br>\n925-864-9323 \r<br>\n*=AMBER*=\r<br>\nCONCORD  INCALL~Availble Right Now !! ~\r<br>\n\r<br>\n\n\n\n<br><br>\n\n                \n\n', sfbay.craigslist.com/eby/ers/1144628649.html', 23, 1, 'sfbay', '2009-04-28, 12:59PM PDT', '3n13md3pfZZZZZZZZZ94se3e652017a9c1d3f.jpg', '2009-04-28 13:26:25'),
(627, 'ALL AMERICAN DREAM GIRL__#1 MOST REQUESTED___X_X_X__G(R)33(K)_PLAYMATE - w4m', '\nHello Gentlemen, My name is Ginger and I am a 21 year college girl . As for my physical appearance: I stand 5''5? and weigh 125 lbs. I have big brown eyes complemented by long natural lashes. My well-developed, all-natural 34C-24-36 figure is maintained by a vigorous daily regime in the gym. I have a wardrobe of the utmost class with a unique sense of style, so you will always be pleased to be seen with me in public. Ginger 646 2 zero 8 seven 5 one 6\r<br>
...
...
...


Sosa 05-13-2009 10:53 AM

too bad most of those are fake bait and switch ads and a lot of images already have other crap on them.

HookUp411 05-13-2009 12:15 PM

http://news.yahoo.com/s/nm/20090513/us_nm/us_craigslist

lavitra 05-13-2009 01:27 PM

Thank you for pointing that out.

Most likely, the erotic services will no longer be under the heading /ers/, if that is the case then its quite simple to fix.

If the changes are significant enough to hinder data extraction, I will provide free update and modification to the code so that you may still be able to collect data from. I can provide any update to the code and support for up to 1 whole year.

Thank you.

lavitra 05-14-2009 02:59 PM

Scraper code updated to work with latest change.
 
So its official that CL will be removing the Erotic Services category and will be using Adult Services.

This is a good news because it will filter out many junk, and fake listings.

The scraper code has been updated to work with this new change, and is successfully fetching data with the adult services category.

HorseShit 05-14-2009 03:03 PM

fuck off

HookUp411 05-14-2009 03:08 PM

yeah looks like they can't talk about services anymore, just put a picture and a phone number.

lavitra 05-14-2009 03:21 PM

service description is still available. according to CL's blog, they pointed out that they will be screened by humans, so spams and other junks are filtered out.

brassmonkey 05-14-2009 04:41 PM

Quote:

Originally Posted by Justin (Post 15853657)
fuck off

:1orglaugh what he said

Si 05-14-2009 08:41 PM

Quote:

Originally Posted by Justin (Post 15853657)
fuck off

:thumbsup

Diomed 05-14-2009 10:01 PM

Hello Dori Dori.

lavitra 05-15-2009 11:53 AM

bump bump

milkit 05-15-2009 12:54 PM

isnt this worthless now? they stopped allowing postings in that on like the 12th. Unless I am missing something that this does...

lavitra 05-15-2009 01:40 PM

the only thing that is changed is the /ers/ category is changed to adult services directory.

escort listings continue. now they are filtered for junk and fake escort listings by humans which only raises the overall quality.

HomerSimpson 05-15-2009 02:55 PM

they just kicked all those ads from cl
you fail!

lavitra 05-15-2009 03:29 PM

Quote:

Originally Posted by HomerSimpson (Post 15857719)
they just kicked all those ads from cl
you fail!

Taken from craigslist blog (blog.craigslist.org):

Quote:

May 13th, 2009 by jim

As of today for all US craigslist sites, postings to the ?erotic services? category will no longer be accepted, and in 7 days the category will be removed.

Also effective today for all US sites, a new category entitled ?adult services? will be opened for postings by legal adult service providers. Each posting to this new category will be manually reviewed before appearing on the site, to ensure compliance with craigslist posting guidelines and terms of use. New postings will cost $10, but once approved, will be eligible for reposting at $5.
I think its pretty much self explanatory.

lavitra 05-16-2009 11:55 AM

bump bump !

fris 05-16-2009 03:23 PM

mod please ban this user

lavitra 05-16-2009 05:50 PM

Quote:

Originally Posted by fris (Post 15860190)
mod please ban this user

perhaps they should ban you for hijacking threads.

lavitra 05-17-2009 09:35 AM

bump bump!

lavitra 05-18-2009 01:06 PM

bump bump!

iTouch! 05-18-2009 04:19 PM

is this what the craigslist killer used? :1orglaugh

Pleasurepays 05-18-2009 04:48 PM

not interested in Escort ads... what else can you steal that i might like? lets talk some business.

lavitra 05-18-2009 06:46 PM

[email protected]

or icq at the bottom.

mikesinner 05-18-2009 11:51 PM

There is no money in craigslist anymore except for guys that talk peeps into buying their software that will make them millions.

lavitra 05-19-2009 09:15 AM

Quote:

Originally Posted by mikesinner (Post 15866401)
There is no money in craigslist anymore except for guys that talk peeps into buying their software that will make them millions.

thats funny coming from you. :1orglaugh

lavitra 05-20-2009 10:54 AM

bump bump!

lavitra 05-21-2009 10:31 AM

bump bump!

lavitra 05-22-2009 12:06 PM

bump bump!

Legendary Samir - BANNED FOR LIFE 05-22-2009 01:05 PM

You and barefootsies need to get together.

lavitra 05-22-2009 01:52 PM

not in to toes....thats just wrong

lavitra 05-22-2009 07:13 PM

Special 25% discount on CL scraper! Order until next Tuesday and receive 25% discount on CL scraper!

lavitra 05-25-2009 12:44 PM

bump bump!


All times are GMT -7. The time now is 04:40 AM.

Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2025, vBulletin Solutions, Inc.
©2000-, AI Media Network Inc