![]() |
![]() |
![]() |
||||
Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums. You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today! If you have any problems with the registration process or your account login, please contact us. |
![]() ![]() |
|
Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed. |
|
Thread Tools |
![]() |
#1 |
So Fucking Banned
Join Date: Dec 2009
Posts: 464
|
$500 Flash Video Embed Crawler Script Source Code
I have a php script that crawls list of websites for flash video embeds, and indexes it. I'm going to sell the source code (no obfustication or encryption).
You put list of URL sites in a txt file, and run the php script. it will extract all the flash video embed codes, along with title, and URL, it finds and stick it into mysql. I can show you a demo of a site running it. |
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#2 |
ICQ:649699063
Industry Role:
Join Date: Mar 2003
Posts: 27,763
|
This is a useful program. It's good that you have a demo, neonlights. Good luck with that.
__________________
Send me an email: [email protected] |
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#3 |
So Fucking Banned
Join Date: Dec 2009
Posts: 464
|
Thank you fatfoo, I spent about 1 month of making it.
The script works with pretty much any URL that has flash video embed codes (except for ajax heavy sites). so just add any tube site which has embed codes, and it will do the rest of the work for you. You can run this comfortably on a server with at least 1TB in my experience. My server in the past couldn't handle the amount of data this scraper was digging up. If anyone's interested just reply, and I will send you the demo, and I am happy to answer any questions. |
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#4 |
Too lazy to set a custom title
Industry Role:
Join Date: Aug 2002
Posts: 55,359
|
500$ is a bit much for a scraper, you can get a whole cms to do this with other features as well.
__________________
Since 1999: 69 Adult Industry awards for Best Hosting Company and professional excellence. ![]() WP Stuff |
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#5 |
So Fucking Banned
Join Date: Dec 2009
Posts: 464
|
what's the cms one ? i am interested if there is one actually.
well 500 also includes the search engine plus the crawler script, dont think there is one like this on the market right now... |
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#6 |
Registered User
Industry Role:
Join Date: Feb 2006
Posts: 22,511
|
|
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#7 |
Confirmed User
Join Date: Nov 2008
Posts: 359
|
But virtually none of the larger tube sites have the full URLs in visible code. The player contains the path (which is kept private) and the HTML contains only the filename. Or sites like Yuvutu use secure streaming where even if you have the exact location of the video it's not valid without the proper (secret) token, and only their player can generate it.
|
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#8 | |
So Fucking Banned
Join Date: Dec 2009
Posts: 464
|
Quote:
|
|
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#9 |
So Fucking Banned
Join Date: Dec 2009
Posts: 464
|
bump bump bump
|
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#10 |
Unregistered Abuser
Industry Role:
Join Date: Feb 2006
Posts: 25,944
|
I'll give you $25 and I get resell rights and shit...
|
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#11 |
one sick puppy
Industry Role:
Join Date: Oct 2004
Location: Where the worst of the West meets the worst of the East
Posts: 11,512
|
|
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#12 |
Confirmed User
Industry Role:
Join Date: Feb 2002
Location: Canada
Posts: 7,674
|
For branding lets just call it FVECSSC mmmkay
|
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#13 |
So Fucking Banned
Join Date: Dec 2009
Posts: 464
|
|
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#14 |
♥♥♥ Likes Hugs ♥♥♥
Industry Role:
Join Date: Nov 2001
Location: /home
Posts: 15,841
|
$500 for a scraper? You've got to be out of your mind.
__________________
I like pie. |
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#15 |
So Fucking Banned
Join Date: Dec 2009
Posts: 464
|
![]() May i know why you think this is high ? It's not on the same level as the cheap single purpose scrapers, or porn scrapers.
This is a full index spider that will crawl pages containing flash video embeds intelligently. Search Engine is also included. It's actually very inexpensive when you consider all the features. It's very flexible to template changes, and will work with any URL that has video embed codes. It runs fine on most servers but you need rather large disk space to store the index files. |
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#16 |
Confirmed User
Industry Role:
Join Date: Aug 2008
Location: Hollywood
Posts: 2,785
|
What about a demo then?
|
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#17 |
So Fucking Banned
Join Date: Dec 2009
Posts: 464
|
Robocrop, can I send you the demo ?
|
![]() |
![]() ![]() ![]() ![]() ![]() |