How to separate xvideos biggest csv database?

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • vintageadult
    Confirmed User
    • Jun 2015
    • 364

    #1

    How to separate xvideos biggest csv database?

    Hi
    Xvideos have biggest database of csv like 600 mb its hard to open and its not adjusted for separate categories. How do you cut it to specific categories?
  • NakedWomenTime
    Confirmed User
    • Oct 2015
    • 567

    #2
    Maybe parse it into a MySQL database. You'll need to learn coding or hire a coder to do that.
    bbNaked | Naked Women Time | Naked Women Time Blog

    Comment

    • wankawonk
      Confirmed User
      • Aug 2015
      • 1018

      #3
      cat xvideos.csv | grep -i CATEGORY

      Comment

      • vintageadult
        Confirmed User
        • Jun 2015
        • 364

        #4
        Originally posted by wankawonk
        cat xvideos.csv | grep -i CATEGORY
        With which software should I use to put that code?

        Comment

        • sarettah
          see you later, I'm gone
          • Oct 2002
          • 14376

          #5
          Originally posted by vintageadult
          With which software should I use to put that code?
          That is a command that is typed in the command line.

          .
          All cookies cleared!

          Comment

          • fiverose
            Registered User
            • Jan 2017
            • 37

            #6
            Search the Keyword first and scrape the videos, Use the keyword as category.

            I do like that

            Comment

            • AdultVariety
              Registered User
              • Jul 2016
              • 35

              #7
              You can use software like 010 Editor if you want to split it up manually.

              Comment

              • Panty Snatcher
                eat a peach for Hours
                • Aug 2013
                • 540

                #8
                easy task , I already done it and have it in a db

                Comment

                • HowlingWulf
                  Confirmed User
                  • Nov 2001
                  • 1662

                  #9
                  I do wish they had a proper API for searching for specific content.
                  WP Porn directory/review theme Maddos $35.

                  webmaster AT howling-wulf.com

                  Comment

                  • brandonstills
                    Confirmed User
                    • Dec 2007
                    • 1964

                    #10
                    Neat. Didn't know they had that.

                    I'm just doing some brainstorming here, trying to figure out what the possibilities are and if people would be interested in partnering.

                    * I can build something to parse and continuously inject the RSS feeds to keep it up to date. It would then be stored in a database.

                    * From there could have features like by category and what not.

                    * I can build a turnkey site generator. You basically just edit a template. I host, you put whatever you want in the template for your own ads, links, etc.

                    Probably charge a flat monthly fee or partner with people and figure out how to split the revenue.

                    Any interest?

                    Brandon Stills
                    Industry and programming veteran
                    [email protected] | skype: brandonstills | ICQ #495-171-318

                    Comment

                    • wankawonk
                      Confirmed User
                      • Aug 2015
                      • 1018

                      #11
                      Originally posted by brandonstills
                      Neat. Didn't know they had that.

                      I'm just doing some brainstorming here, trying to figure out what the possibilities are and if people would be interested in partnering.

                      * I can build something to parse and continuously inject the RSS feeds to keep it up to date. It would then be stored in a database.

                      * From there could have features like by category and what not.

                      * I can build a turnkey site generator. You basically just edit a template. I host, you put whatever you want in the template for your own ads, links, etc.

                      Probably charge a flat monthly fee or partner with people and figure out how to split the revenue.

                      Any interest?
                      you're a programmer in the industry since 2007 and somehow it's news to you that tube sites offer database dumps...like have you ever googled a porn keyword?

                      Comment

                      • Kafka
                        Confirmed User
                        • Oct 2002
                        • 466

                        #12
                        awk is your friend:

                        awk '/string/ { print }' yourfile -> print every line with "string"

                        example:
                        awk '/milf/ { print }' yourfile -> print every line with "milf"
                        awk '/milf/ { print }' yourfile > to_new_file

                        You can split a big file in pieces:
                        split -l 1000 yourfile newfiles (1000 lines )

                        These are all linux/osx commands. Some like awk are also available for Windows but i am not sure.
                        Learn awk and you can do almost anything with a file.

                        But the best is to import the data into a database, learn php/mysql.

                        Comment

                        • brandonstills
                          Confirmed User
                          • Dec 2007
                          • 1964

                          #13
                          Originally posted by wankawonk
                          you're a programmer in the industry since 2007 and somehow it's news to you that tube sites offer database dumps...like have you ever googled a porn keyword?
                          Started in adult in 2003. Went back to mainstream in 2010. Back to adult now. Never really looked into integrating with tube sites I guess. I concentrated more on building custom CMS solutions.

                          Brandon Stills
                          Industry and programming veteran
                          [email protected] | skype: brandonstills | ICQ #495-171-318

                          Comment

                          Working...