Tech how to scrape wordpress site ? - GoFuckYourself.com

freecartoonporn · 09-24-2017, 05:41 AM

what are you guys using ?

i have list of urls , i need to scrape, images and or videos from.
target site is using wordpress.

i can create crawler myself using php simple html dom., but why reinvent the wheel.,

what is best out there ?

with scheduling and keeping watch on target site. , auto create categories, tags, auto scrape images , include them in our posts and set post as draft.

thanks for your time.

k0nr4d · 09-24-2017, 05:46 AM

Why not just use the RSS feed?

freecartoonporn · 09-24-2017, 05:47 AM

Quote:

Originally Posted by k0nr4d

Why not just use the RSS feed?

there are old posts, on target site, and i am not sure., they will be in feed., as basically feed has limit to last 10 posts , i guess.

is thre way i can access old posts using feed ?

klinton · 09-24-2017, 07:20 AM

Cyberseo

freecartoonporn · 09-24-2017, 08:51 AM

i have list of thousands of urls, i need to scrape. and create posts in draft mode., then i can only publish it after checking each post. for valid image links.

freecartoonporn · 09-24-2017, 08:52 AM

Quote:

Originally Posted by klinton

Cyberseo

i have list of thousands of urls, i need to scrape. and create posts in draft mode., then i can only publish it after checking each post. for valid image links.

is it possible with cyberseo.,
which version, cheap or expensive one ?

klinton · 09-24-2017, 09:45 AM

which version of it is cheap ?

im talking about normal version.
all options that you mentioned are default, the last one either is default (if i understand you correctly) or need some small simple parser to be written in php.
speak with Cyberseo, he posts here.

Quote:

Originally Posted by freecartoonporn

i have list of thousands of urls, i need to scrape. and create posts in draft mode., then i can only publish it after checking each post. for valid image links.

is it possible with cyberseo.,
which version, cheap or expensive one ?

freecartoonporn · 09-24-2017, 09:59 AM

Quote:

Originally Posted by klinton

which version of it is cheap ?

im talking about normal version.
all options that you mentioned are default, the last one either is default (if i understand you correctly) or need some small simple parser to be written in php.
speak with Cyberseo, he posts here.

i meant, the one which has lower price that other one.

i am still looking for more options, so i can decide .

cordoba · 09-24-2017, 01:44 PM

Quote:

Originally Posted by klinton

Cyberseo

Surely Google is clever enough these days to scan (and penalize) sites for using an overtly blackhat plugin?

brassmonkey · 09-24-2017, 02:41 PM

i can scrape it for a fee

Smack dat · 09-24-2017, 02:43 PM

There are loads of nulled cyberseo around.

freecartoonporn · 09-24-2017, 06:53 PM

Quote:

Originally Posted by brassmonkey

i can scrape it for a fee

Quote:

i can create crawler myself using php simple html dom., but why reinvent the wheel.,

Quote:

Originally Posted by Smack dat

There are loads of nulled cyberseo around.

nulled = bugged.

brassmonkey · 09-24-2017, 07:24 PM

Quote:

Originally Posted by freecartoonporn

nulled = bugged.

free = go fuck yourself! nulled my software is paid for

Barry-xlovecam · 09-24-2017, 08:45 PM

So you want help stealing the other guy's shit ... NO

Not only that but you want to hotlink to the stolen shit too?

Even dumber than dumb -- you post a thread to leave a record of your malfeasance.

Congratulations, you get the GFY dumb-fuck of the month award -- a bag of poop from?

Get a new fuckin' plan

freecartoonporn · 09-24-2017, 09:40 PM

Quote:

Originally Posted by Barry-xlovecam

So you want help stealing the other guy's shit ... NO

i am stealing from thief, i know two wrong does not make one right but still , i wanna try before i die.

Quote:

Not only that but you want to hotlink to the stolen shit too?

where i said, that i want to hotlink ?

i want to downlod content to my server.

Quote:

Even dumber than dumb -- you post a thread to leave a record of your malfeasance.

nobody cares.

Quote:

Congratulations, you get the GFY dumb-fuck of the month award -- a bag of poop from?

thanks.

Quote:

Get a new fuckin' plan

not until this plan fails.

just a punk · 09-25-2017, 12:04 AM

Quote:

Originally Posted by freecartoonporn

there are old posts, on target site, and i am not sure., they will be in feed., as basically feed has limit to last 10 posts , i guess.

is thre way i can access old posts using feed ?

Quote:

Originally Posted by freecartoonporn

what are you guys using ?

1) Install CyberSEO.
2) Add a link to WordrPress RSS feed.
3) Enable "Parse WordPress archives" option.

The target site will be fully scraped - doesn't matter how many posts it has in the RSS feed (1, 10 or none), the plugin will scrape just EVERYTHING - yes, including all old posts that you can't see in the RSS feed. It will even copy all the media to your host if you want it.

Quote:

Originally Posted by cordoba

Surely Google is clever enough these days to scan (and penalize) sites for using an overtly blackhat plugin?

My plugin is undetectable. The script file gives 404 error if you try to open it. The same does the plugin's folder.

Quote:

Originally Posted by freecartoonporn

nulled = bugged.

The version of 2012 which is floating on the net is very old, buggy and there is a backdoor added by hackers. No updates and no support too (you can't even read the official forum).

just a punk · 09-25-2017, 12:21 AM

Quote:

Originally Posted by Barry-xlovecam

So you want help stealing the other guy's shit ...

I won't be so radical here. There are many promo blogs that belong to affiliate programs and made to promote their paysites. The problem is that their RSS feeds include the most recent posts only. My plugin allows to scrape the old posts too.

freecartoonporn · 09-25-2017, 02:04 AM

Quote:

Originally Posted by CyberSEO

1) Install CyberSEO.
2) Add a link to WordrPress RSS feed.
3) Enable "Parse WordPress archives" option.

The target site will be fully scraped - doesn't matter how many posts it has in the RSS feed (1, 10 or none), the plugin will scrape just EVERYTHING - yes, including all old posts that you can't see in the RSS feed. It will even copy all the media to your host if you want it.

My plugin is undetectable. The script file gives 404 error if you try to open it. The same does the plugin's folder.

The version of 2012 which is floating on the net is very old, buggy and there is a backdoor added by hackers. No updates and no support too (you can't even read the official forum).

will it auto scrape new posts too ?

looks like i missed the boat, theres no lite version ?

just a punk · 09-25-2017, 02:06 AM

Quote:

Originally Posted by freecartoonporn

will it auto scrape new posts too ?

Yes, of course. It will do it automatically.

Quote:

Originally Posted by freecartoonporn

looks like i missed the boat, there no lite version?

There is no lite version anymore. Only the unlimited one.

freecartoonporn · 09-25-2017, 02:30 AM

Quote:

Originally Posted by CyberSEO

Yes, of course. It will do it automatically.

There is no lite version anymore. Only the unlimited one.

can i use delete id feeds to delete the specific id posts from our site ?

i mean like MGP/TGP2 guys do it. big tubes provide deleted id feed.

just a punk · 09-25-2017, 03:17 AM

Quote:

Originally Posted by freecartoonporn

can i use delete id feeds to delete the specific id posts from our site ?

i mean like MGP/TGP2 guys do it. big tubes provide deleted id feed.

You mean to use an RSS feed with id of posts that have to be deleted? With CyberSEO - you can't do it. I can write a special plugin for that.

freecartoonporn · 09-25-2017, 03:51 AM

Quote:

Originally Posted by CyberSEO

You mean to use an RSS feed with id of posts that have to be deleted? With CyberSEO - you can't do it. I can write a special plugin for that.

okie., can it rename file names ?
and save using new file names.

just a punk · 09-25-2017, 04:50 AM

Quote:

Originally Posted by freecartoonporn

okie., can it rename file names ?
and save using new file names.

Sure, why not? By default CyberSEO uses the original post title to rename the downloaded media. E.g.: Playboy Playmates

freecartoonporn · 09-25-2017, 08:11 AM

Quote:

Originally Posted by CyberSEO

Sure, why not? By default CyberSEO uses the original post title to rename the downloaded media. E.g.: Playboy Playmates

is there str replace ., so in case , post content has domain name, i would like to replace it with mine.

something like that ?

09-24-2017, 05:41 AM	#1
freecartoonporn Confirmed User Industry Role: Join Date: Jan 2012 Location: NC Posts: 7,683	how to scrape wordpress site ? what are you guys using ? i have list of urls , i need to scrape, images and or videos from. target site is using wordpress. i can create crawler myself using php simple html dom., but why reinvent the wheel., what is best out there ? with scheduling and keeping watch on target site. , auto create categories, tags, auto scrape images , include them in our posts and set post as draft. thanks for your time. __________________ SSD Cloud Server, VPS Server, Simple Cloud Hosting \| DigitalOcean

09-24-2017, 05:46 AM	#2
k0nr4d Confirmed User Industry Role: Join Date: Aug 2006 Location: Poland Posts: 9,228	Why not just use the RSS feed? __________________ Mechanical Bunny Media Mechbunny Tube Script \| Mechbunny Webcam Aggregator Script \| Custom Web Development

09-24-2017, 08:51 AM	#5
freecartoonporn Confirmed User Industry Role: Join Date: Jan 2012 Location: NC Posts: 7,683	i have list of thousands of urls, i need to scrape. and create posts in draft mode., then i can only publish it after checking each post. for valid image links. __________________ SSD Cloud Server, VPS Server, Simple Cloud Hosting \| DigitalOcean

09-24-2017, 02:41 PM	#10
brassmonkey Pay It Forward Industry Role: Join Date: Sep 2005 Location: Yo Mama House Posts: 76,906	i can scrape it for a fee __________________ TRUMP 2025 KEKAW!!! - Support The Laken Riley Act!!! END DACA - SUPPORT AZ HCR 2060 52R - email: brassballz-at-techie.com

09-24-2017, 07:20 AM	#4
klinton So Fucking Banned Industry Role: Join Date: Apr 2003 Location: online Posts: 8,766	Cyberseo

09-24-2017, 02:43 PM	#11
Smack dat So Fucking Banned Industry Role: Join Date: Jul 2016 Posts: 4,613	There are loads of nulled cyberseo around.

09-24-2017, 08:45 PM	#14
Barry-xlovecam It's 42 Industry Role: Join Date: Jun 2010 Location: Global Posts: 18,083	So you want help stealing the other guy's shit ... NO Not only that but you want to hotlink to the stolen shit too? Even dumber than dumb -- you post a thread to leave a record of your malfeasance. Congratulations, you get the GFY dumb-fuck of the month award -- a bag of poop from? Get a new fuckin' plan