GoFuckYourself.com - Adult Webmaster Forum - New Cloudflare AI Scrapers and Crawlers Filter

GoFuckYourself.com - Adult Webmaster Forum (https://gfy.com/index.php)

- Fucking Around & Business Discussion (https://gfy.com/forumdisplay.php?f=26)

- - New Cloudflare AI Scrapers and Crawlers Filter (https://gfy.com/showthread.php?t=1376739)

Shoplifter

07-01-2024 01:35 PM

New Cloudflare AI Scrapers and Crawlers Filter

Anyone else using this? On some of my sites it's blocking > 50k a day. CPU load has fallen commensurably

Any thoughts on this? Downsides?

gar	07-01-2024 02:43 PM

Quote:

Originally Posted by Shoplifter (Post 23279686)

Anyone else using this? On some of my sites it's blocking > 50k a day. CPU load has fallen commensurably

Any thoughts on this? Downsides?

Been using it since day one it's available but on AWS WAF. AI won't answer your site URL. :1orglaugh They're crawling like crazy! Faster and more frequent than Google!

All times are GMT -7. The time now is 09:38 PM.