Hacking the Googlebot--Mobile Update
See Googlebot, See Googlebot run!
user@(...)/log:~$ grep -ni --color=always "google" access.log |grep "[pagename]"
2793:66.249.65.185 - - [03/May/2015:01:21:07 -0400] "GET /[pagename]/ HTTP/1.1" 200 5615 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
5661:66.249.65.181 - - [03/May/2015:06:51:46 -0400] "GET /[pagename]/ HTTP/1.1" 200 5653 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
9946:66.249.64.83 - - [03/May/2015:13:42:41 -0400] "GET /[pagename]/ HTTP/1.1" 200 5548 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
13724:66.249.64.85 - - [03/May/2015:18:53:13 -0400] "GET /[pagename]/ HTTP/1.1" 200 5549 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
17795:66.249.64.152 - - [04/May/2015:03:18:39 -0400] "GET /[pagename]/ HTTP/1.1" 200 5567 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
22678:66.249.67.108 - - [04/May/2015:13:04:41 -0400] "GET /[scriptname].min.js HTTP/1.1" 200 790 "http://[domain]/[pagename]/" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
22679:66.249.67.116 - - [04/May/2015:13:04:42 -0400] "GET /[scriptname].css HTTP/1.1" 200 533 "http://[domain]/[pagename]/" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
Your JavaScripts and CSS files are requested and checked?
40514:66.249.67.158 - - [06/May/2015:01:30:43 -0400] "GET /[pagename]l HTTP/1.1" 200 5531 "-" "Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 (KHTML, like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
50553:66.249.67.171 - - [06/May/2015:21:52:31 -0400] "GET /[pagename]l HTTP/1.1" 200 5544 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
For the record:
The log was rotated.
The page has been indexed for years.
The page's SERPs are the worst on that domain making it good for an experiment.
This page was changed from a PC style page to a responsive (100%) at 600px landscape format May 2, 2015
All pages in this subdirectory level will be updated to the same and the SERP referrals noted.
So I passed the mobilgeddon test at 600px?
This is a conversion of a old thumbnail dynamic affiliate site -- the menus were the issue (width) and the desire that the new PC site would be of familiar design with all the features that the return visitors expect and know were the content can be found.
Learning curve was a bitch and time the issue but the same changes can be adapted to other domains as well.
user@(...)/log:~$grep -ni --color=always "google" access.log |grep "[pagename]" |grep -i "q="|cut -d '"' -f5,6|more
will tell the whole story
just gets the user agent of all search queries for that page ...
|