Crawling Legality Issues - GoFuckYourself.com

JamesRocket · 06-26-2012, 05:53 AM

Hello all,

I was wondering how crawling is looked upon. Me and my business partner want to crawl some tube sites (so we can create our own database structure instead of using an existing one).

The only information we are after are the embed codes and meta information such as tags and duration etc.

Is this okay or frowned upon? ;)

Thanks in advance,

James

AllAboutCams · 06-26-2012, 06:05 AM

just do it
why would you ask ?

JamesRocket · 06-26-2012, 06:18 AM

Quote:

Originally Posted by xxxupdate

just do it
why would you ask ?

Because webmasters could easily block us. Maybe it's nice to ask first or whatever. So that's why I'm asking if it's an issue.

Markul · 06-26-2012, 06:59 AM

Welcome to GFY

and good luck

RachelBlackG · 06-26-2012, 02:37 PM

It should be ok. But do not copy titles and tags 1:1 to your website. Make it a little different. Duplicity is bad.

xenigo · 06-30-2012, 04:25 PM

James... the term is "scraping".

Crawling is simply going from link to link finding web pages. Scraping is collecting information with the intent to republish.

Quora: What is the difference between crawling and scraping?

06-26-2012, 05:53 AM	#1
JamesRocket Registered User Industry Role: Join Date: Apr 2012 Posts: 2	Crawling Legality Issues Hello all, I was wondering how crawling is looked upon. Me and my business partner want to crawl some tube sites (so we can create our own database structure instead of using an existing one). The only information we are after are the embed codes and meta information such as tags and duration etc. Is this okay or frowned upon? ;) Thanks in advance, James

06-26-2012, 06:05 AM	#2
AllAboutCams Femcams.com Industry Role: Join Date: Jul 2011 Location: bjcam.com Posts: 12,220	just do it why would you ask ? __________________ Binance - Blockchain and Crypto Asset Exchange Chaturbate make money in cams

06-26-2012, 06:59 AM	#4
Markul Likes Pie Industry Role: Join Date: Dec 2007 Location: The land that liberated porn Posts: 12,402	Welcome to GFY and good luck

06-26-2012, 02:37 PM	#5
RachelBlackG Elysium Industry Role: Join Date: Feb 2011 Location: Prague Posts: 1,037	It should be ok. But do not copy titles and tags 1:1 to your website. Make it a little different. Duplicity is bad.

06-30-2012, 04:25 PM	#6
xenigo Confirmed User Industry Role: Join Date: Jan 2001 Location: Oakland, CA Posts: 8,067	James... the term is "scraping". Crawling is simply going from link to link finding web pages. Scraping is collecting information with the intent to republish. Quora: What is the difference between crawling and scraping?