GoFuckYourself.com - Adult Webmaster Forum

GoFuckYourself.com - Adult Webmaster Forum (https://gfy.com/index.php)
-   Fucking Around & Business Discussion (https://gfy.com/forumdisplay.php?f=26)
-   -   Coder wanted (https://gfy.com/showthread.php?t=1322603)

mce 01-29-2020 02:44 AM

Coder wanted
 
I need a simple script that scrapes Google for search results and verifies those pages (ie., checks each result if it fits my parameters)

The ones that pass are put in a .txt file I can download

My budget is < $200

just a punk 01-29-2020 04:17 AM

There are many free Google scraper scripts in the Net. The problem is that you (the script) will be sent to recaptcha after a few dozen requests...

You will end up emailing the coder who made that script with messages like: "Ahh! There is a bug! Your script stopped working within a hour! Fix it! Do something! The sky is falling!"

Anyways, good luck with that )

k0nr4d 01-29-2020 04:35 AM

Quote:

Originally Posted by CyberSEO (Post 22601015)
There are many free Google scraper scripts in the Net. The problem is that you (the script) will be sent to recaptcha after a few dozen requests...

You will end up emailing the coder who made that script with messages like: "Ahh! There is a bug! Your script stopped working within a hour! Fix it! Do something! The sky is falling!"

Anyways, good luck with that )

https://developers.google.com/custom-search/v1/overview

Paul&John 01-29-2020 04:57 AM

Quote:

Originally Posted by k0nr4d (Post 22601022)

Quote:

Custom Search JSON API provides 100 search queries per day for free. If you need more, you may sign up for billing in the API Console. Additional requests cost $5 per 1000 queries, up to 10k queries per day.
Not sure if the budget will be enough for this as well :)

just a punk 01-29-2020 05:40 AM

Quote:

Originally Posted by k0nr4d (Post 22601022)

He said his budget is less than $200.

Klen 01-29-2020 06:12 AM

Quote:

Originally Posted by CyberSEO (Post 22601015)
There are many free Google scraper scripts in the Net. The problem is that you (the script) will be sent to recaptcha after a few dozen requests...

You will end up emailing the coder who made that script with messages like: "Ahh! There is a bug! Your script stopped working within a hour! Fix it! Do something! The sky is falling!"

Anyways, good luck with that )

Yep, those fucks wants to limit almost everything of what they offer.

k0nr4d 01-29-2020 06:20 AM

Quote:

Originally Posted by CyberSEO (Post 22601045)
He said his budget is less than $200.

Yeah, was just pointing out that there is another way to do it then scraping.

ghjghj 01-29-2020 07:59 AM

Quote:

Originally Posted by mce (Post 22600984)
a simple script

Quote:

Originally Posted by mce (Post 22600984)
that scrapes Google

https://i.imgur.com/WytAaBM.gif

~Evilin~ 01-29-2020 08:19 AM

Quote:

Originally Posted by CyberSEO (Post 22601015)
You will end up emailing the coder who made that script with messages like: "Ahh! There is a bug! Your script stopped working within a hour! Fix it! Do something! The sky is falling!"


:1orglaugh:1orglaugh

EddyTheDog 01-29-2020 09:24 AM

Quote:

Originally Posted by k0nr4d (Post 22601051)
Yeah, was just pointing out that there is another way to do it then scraping.

I think you could scrape the results from a CSE - I have never hit a recapture on those and I have been playing with a lot recently - Also, you get $300 credit when you open an account with Google - That would buy you a few searches with the JSON api - 60,000 in fact...

That would give you a lot of power over the results as well - You can perform all sorts of magic with it.....

Edit: Drop me a PM with more detail about what you want and if I think I can do it I will make you an offer - I could chuck in $50 worth of JSON api credit so you would get 10K searches - They would be highly customized searches so would work out better value than scraping standard Google results and without the recapture issue...

I could feed them into a DB and give you a way of pulling them in any format you wanted......

Klen 01-29-2020 12:33 PM

Quote:

Originally Posted by EddyTheDog (Post 22601145)
I think you could scrape the results from a CSE - I have never hit a recapture on those and I have been playing with a lot recently - Also, you get $300 credit when you open an account with Google - That would buy you a few searches with the JSON api - 60,000 in fact...

That would give you a lot of power over the results as well - You can perform all sorts of magic with it.....

Edit: Drop me a PM with more detail about what you want and if I think I can do it I will make you an offer - I could chuck in $50 worth of JSON api credit so you would get 10K searches - They would be highly customized searches so would work out better value than scraping standard Google results and without the recapture issue...

I could feed them into a DB and give you a way of pulling them in any format you wanted......

Technically, with proxy/browser mix it might be possible to override limit issue.

EddyTheDog 01-29-2020 04:35 PM

Quote:

Originally Posted by Klen (Post 22601251)
Technically, with proxy/browser mix it might be possible to override limit issue.

Yeah - If he wants all in for <$200 though he would be pushing his luck...

I'm not sure what he needs - It might even be better to go for a 15 trial on SEMRush and grab as much data that he can - It depends on the info he is trying to pull.....

Edit: If he is looking for data about site positions in SERPS then he would have to use a scrape - The API results are different to normal search results - SEMRush would be good for that as well - I have a link for the 15 day trial somewhere, you don't normally get it...

CaptainHowdy 01-29-2020 04:53 PM

https://gfy.com/image.php?u=178579&dateline=1543121336

ANAL PASTE 01-29-2020 05:30 PM

Lots of free scripts out there. If you know a bit of php use one of those.


All times are GMT -7. The time now is 11:06 PM.

Powered by vBulletin® Version 3.8.8
Copyright ©2000 - 2025, vBulletin Solutions, Inc.
©2000-, AI Media Network Inc