Thread: Business AWE whitelabel & robots.txt
View Single Post
Old 11-08-2018, 01:27 PM  
incredibleworkethic
Confirmed User
 
incredibleworkethic's Avatar
 
Industry Role:
Join Date: Sep 2009
Posts: 2,302
Quote:
Originally Posted by xxx6live View Post
Yeah,

and exactly therefore (the canonical) you should block it via robots.txt so it at least ranks for its domain name.

If you block it in robots.txt Google does not does not see the canonical. So it will rank for the domain name (but nothing else).

There is a checkbox in the "SEO" section saying "Allow robots" - remove it and it is disallowed via robots.txt.
.
I have clicked allow robots and it was working before. I have been in contact with support they say they are having an issue and are working on it.

Not sure why it's taking so long to remove a line of text but it is.
incredibleworkethic is offline   Share thread on Digg Share thread on Twitter Share thread on Reddit Share thread on Facebook Reply With Quote