Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums.

You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today!

If you have any problems with the registration process or your account login, please contact us.

Post New Thread Reply

Register GFY Rules Calendar
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >
Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed.

 
Thread Tools
Old 02-01-2017, 10:51 AM   #1
vintageadult
Confirmed User
 
Industry Role:
Join Date: Jun 2015
Location: NL
Posts: 358
How to separate xvideos biggest csv database?

Hi
Xvideos have biggest database of csv like 600 mb its hard to open and its not adjusted for separate categories. How do you cut it to specific categories?
vintageadult is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 02-01-2017, 12:07 PM   #2
NakedWomenTime
Confirmed User
 
NakedWomenTime's Avatar
 
Industry Role:
Join Date: Oct 2015
Posts: 560
Maybe parse it into a MySQL database. You'll need to learn coding or hire a coder to do that.
NakedWomenTime is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 02-01-2017, 03:53 PM   #3
wankawonk
Confirmed User
 
Industry Role:
Join Date: Aug 2015
Posts: 1,017
cat xvideos.csv | grep -i CATEGORY
wankawonk is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 02-01-2017, 08:07 PM   #4
vintageadult
Confirmed User
 
Industry Role:
Join Date: Jun 2015
Location: NL
Posts: 358
Quote:
Originally Posted by wankawonk View Post
cat xvideos.csv | grep -i CATEGORY
With which software should I use to put that code?
vintageadult is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 02-01-2017, 09:44 PM   #5
sarettah
see you later, I'm gone
 
Industry Role:
Join Date: Oct 2002
Posts: 14,057
Quote:
Originally Posted by vintageadult View Post
With which software should I use to put that code?
That is a command that is typed in the command line.

.
__________________
All cookies cleared!
sarettah is online now   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 02-01-2017, 11:00 PM   #6
fiverose
Registered User
 
Industry Role:
Join Date: Jan 2017
Posts: 37
Search the Keyword first and scrape the videos, Use the keyword as category.

I do like that
fiverose is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 02-04-2017, 09:48 AM   #7
AdultVariety
Registered User
 
AdultVariety's Avatar
 
Industry Role:
Join Date: Jul 2016
Posts: 35
You can use software like 010 Editor if you want to split it up manually.
AdultVariety is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 02-04-2017, 11:39 AM   #8
Panty Snatcher
eat a peach for Hours
 
Industry Role:
Join Date: Aug 2013
Posts: 540
easy task , I already done it and have it in a db
Panty Snatcher is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 02-04-2017, 12:57 PM   #9
HowlingWulf
Confirmed User
 
HowlingWulf's Avatar
 
Join Date: Nov 2001
Posts: 1,662
I do wish they had a proper API for searching for specific content.
__________________
WP Porn directory/review theme Maddos $35.

webmaster AT howling-wulf.com
HowlingWulf is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 02-05-2017, 04:18 PM   #10
brandonstills
Confirmed User
 
brandonstills's Avatar
 
Join Date: Dec 2007
Location: Chatsworth, CA
Posts: 1,964
Neat. Didn't know they had that.

I'm just doing some brainstorming here, trying to figure out what the possibilities are and if people would be interested in partnering.

* I can build something to parse and continuously inject the RSS feeds to keep it up to date. It would then be stored in a database.

* From there could have features like by category and what not.

* I can build a turnkey site generator. You basically just edit a template. I host, you put whatever you want in the template for your own ads, links, etc.

Probably charge a flat monthly fee or partner with people and figure out how to split the revenue.

Any interest?
brandonstills is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 02-05-2017, 06:24 PM   #11
wankawonk
Confirmed User
 
Industry Role:
Join Date: Aug 2015
Posts: 1,017
Quote:
Originally Posted by brandonstills View Post
Neat. Didn't know they had that.

I'm just doing some brainstorming here, trying to figure out what the possibilities are and if people would be interested in partnering.

* I can build something to parse and continuously inject the RSS feeds to keep it up to date. It would then be stored in a database.

* From there could have features like by category and what not.

* I can build a turnkey site generator. You basically just edit a template. I host, you put whatever you want in the template for your own ads, links, etc.

Probably charge a flat monthly fee or partner with people and figure out how to split the revenue.

Any interest?
you're a programmer in the industry since 2007 and somehow it's news to you that tube sites offer database dumps...like have you ever googled a porn keyword?
wankawonk is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 02-06-2017, 03:22 AM   #12
Kafka
Confirmed User
 
Kafka's Avatar
 
Join Date: Oct 2002
Location: Holland
Posts: 466
awk is your friend:

awk '/string/ { print }' yourfile -> print every line with "string"

example:
awk '/milf/ { print }' yourfile -> print every line with "milf"
awk '/milf/ { print }' yourfile > to_new_file

You can split a big file in pieces:
split -l 1000 yourfile newfiles (1000 lines )

These are all linux/osx commands. Some like awk are also available for Windows but i am not sure.
Learn awk and you can do almost anything with a file.

But the best is to import the data into a database, learn php/mysql.
Kafka is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Old 02-07-2017, 01:51 AM   #13
brandonstills
Confirmed User
 
brandonstills's Avatar
 
Join Date: Dec 2007
Location: Chatsworth, CA
Posts: 1,964
Quote:
Originally Posted by wankawonk View Post
you're a programmer in the industry since 2007 and somehow it's news to you that tube sites offer database dumps...like have you ever googled a porn keyword?
Started in adult in 2003. Went back to mainstream in 2010. Back to adult now. Never really looked into integrating with tube sites I guess. I concentrated more on building custom CMS solutions.
brandonstills is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote
Post New Thread Reply
Go Back   GoFuckYourself.com - Adult Webmaster Forum > >

Bookmarks

Tags
database, categories, csv, biggest, separate, xvideos, adjusted, specific, cut, hard



Advertising inquiries - marketing at gfy dot com

Contact Admin - Advertise - GFY Rules - Top

©2000-, AI Media Network Inc



Powered by vBulletin
Copyright © 2000- Jelsoft Enterprises Limited.