![]() |
![]() |
![]() |
||||
Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums. You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today! If you have any problems with the registration process or your account login, please contact us. |
![]() ![]() |
|
Discuss what's fucking going on, and which programs are best and worst. One-time "program" announcements from "established" webmasters are allowed. |
|
Thread Tools |
![]() |
#1 |
Confirmed User
Industry Role:
Join Date: Jun 2015
Location: NL
Posts: 358
|
How to separate xvideos biggest csv database?
Hi
Xvideos have biggest database of csv like 600 mb its hard to open and its not adjusted for separate categories. How do you cut it to specific categories? |
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#2 |
Confirmed User
Industry Role:
Join Date: Oct 2015
Posts: 560
|
Maybe parse it into a MySQL database. You'll need to learn coding or hire a coder to do that.
|
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#3 |
Confirmed User
Industry Role:
Join Date: Aug 2015
Posts: 1,017
|
cat xvideos.csv | grep -i CATEGORY
|
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#4 |
Confirmed User
Industry Role:
Join Date: Jun 2015
Location: NL
Posts: 358
|
|
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#5 |
see you later, I'm gone
Industry Role:
Join Date: Oct 2002
Posts: 14,057
|
That is a command that is typed in the command line.
.
__________________
All cookies cleared! |
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#6 |
Registered User
Industry Role:
Join Date: Jan 2017
Posts: 37
|
Search the Keyword first and scrape the videos, Use the keyword as category.
I do like that |
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#7 |
Registered User
Industry Role:
Join Date: Jul 2016
Posts: 35
|
You can use software like 010 Editor if you want to split it up manually.
|
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#8 |
eat a peach for Hours
Industry Role:
Join Date: Aug 2013
Posts: 540
|
easy task , I already done it and have it in a db
![]() |
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#10 |
Confirmed User
Join Date: Dec 2007
Location: Chatsworth, CA
Posts: 1,964
|
Neat. Didn't know they had that.
I'm just doing some brainstorming here, trying to figure out what the possibilities are and if people would be interested in partnering. * I can build something to parse and continuously inject the RSS feeds to keep it up to date. It would then be stored in a database. * From there could have features like by category and what not. * I can build a turnkey site generator. You basically just edit a template. I host, you put whatever you want in the template for your own ads, links, etc. Probably charge a flat monthly fee or partner with people and figure out how to split the revenue. Any interest? |
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#11 | |
Confirmed User
Industry Role:
Join Date: Aug 2015
Posts: 1,017
|
Quote:
|
|
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#12 |
Confirmed User
Join Date: Oct 2002
Location: Holland
Posts: 466
|
awk is your friend:
awk '/string/ { print }' yourfile -> print every line with "string" example: awk '/milf/ { print }' yourfile -> print every line with "milf" awk '/milf/ { print }' yourfile > to_new_file You can split a big file in pieces: split -l 1000 yourfile newfiles (1000 lines ) These are all linux/osx commands. Some like awk are also available for Windows but i am not sure. Learn awk and you can do almost anything with a file. But the best is to import the data into a database, learn php/mysql. |
![]() |
![]() ![]() ![]() ![]() ![]() |
![]() |
#13 |
Confirmed User
Join Date: Dec 2007
Location: Chatsworth, CA
Posts: 1,964
|
Started in adult in 2003. Went back to mainstream in 2010. Back to adult now. Never really looked into integrating with tube sites I guess. I concentrated more on building custom CMS solutions.
|
![]() |
![]() ![]() ![]() ![]() ![]() |