How to separate xvideos biggest csv database?
 

Hi
Xvideos have biggest database of csv like 600 mb its hard to open and its not adjusted for separate categories. How do you cut it to specific categories?

Maybe parse it into a MySQL database. You'll need to learn coding or hire a coder to do that.

cat xvideos.csv | grep -i CATEGORY

With which software should I use to put that code?

That is a command that is typed in the command line.

.

Search the Keyword first and scrape the videos, Use the keyword as category.

I do like that

You can use software like 010 Editor if you want to split it up manually.

easy task , I already done it and have it in a db :)

I do wish they had a proper API for searching for specific content.

Neat. Didn't know they had that.

I'm just doing some brainstorming here, trying to figure out what the possibilities are and if people would be interested in partnering.

* I can build something to parse and continuously inject the RSS feeds to keep it up to date. It would then be stored in a database.

* From there could have features like by category and what not.

* I can build a turnkey site generator. You basically just edit a template. I host, you put whatever you want in the template for your own ads, links, etc.

Probably charge a flat monthly fee or partner with people and figure out how to split the revenue.

Any interest?

you're a programmer in the industry since 2007 and somehow it's news to you that tube sites offer database dumps...like have you ever googled a porn keyword?

awk is your friend:

awk '/string/ { print }' yourfile -> print every line with "string"

example:
awk '/milf/ { print }' yourfile -> print every line with "milf"
awk '/milf/ { print }' yourfile > to_new_file

You can split a big file in pieces:
split -l 1000 yourfile newfiles (1000 lines )

These are all linux/osx commands. Some like awk are also available for Windows but i am not sure.
Learn awk and you can do almost anything with a file.

But the best is to import the data into a database, learn php/mysql.

Started in adult in 2003. Went back to mainstream in 2010. Back to adult now. Never really looked into integrating with tube sites I guess. I concentrated more on building custom CMS solutions.