|
|
|
|
||||
|
Welcome to the GoFuckYourself.com - Adult Webmaster Forum forums. You are currently viewing our boards as a guest which gives you limited access to view most discussions and access our other features. By joining our free community you will have access to post topics, communicate privately with other members (PM), respond to polls, upload content and access many other special features. Registration is fast, simple and absolutely free so please, join our community today! If you have any problems with the registration process or your account login, please contact us. |
|
|||||||
| New Webmasters ask "How-To" questions here. This is where other fucking Webmasters help. |
|
|
Thread Tools |
03-15-2013, 02:42 PM
|
#1 |
|
Confirmed User
Industry Role:
Join Date: Nov 2012
Posts: 402
|
Robot files and SEO
I was watching some SEO videos lately just to get an idea of certain things, but I thought of something that I can never seem to find anything on.
Do webpages that are blocked by a robots file affect SEO for the pages that are indexed? Does a search engine scan the whole site, but then only index what the robots allows, or does it just scan that pages allowed by the robot and totally ignores the rest, for SEO ranking purposes etc.. ? Anyone have any idea?
__________________
Actual Free Porn Cams - 100% Real Actual Free Porn Cams and Porn Cam Sites HD High Res Porn - The Hottest HD Digh Def 18+ Teen Porn, Milf, Lesbian & Erotica. |
|
|
|
03-15-2013, 03:03 PM
|
#2 |
|
Confirmed User
Industry Role:
Join Date: Oct 2011
Posts: 474
|
I think it completely ignores the pages the robot file lists.
__________________
|
|
|
|
