Project

General

Profile

Actions
Copy link

Support #3911

closed

Subdomains blocking googlebot?

Added by Matt Gold over 9 years ago. Updated over 9 years ago.

Status:
Resolved
Priority name:
Normal
Assignee:
Matt Gold
Category name:
SEO
Target version:
Not tracked
Start date:
2015-03-12
Due date:
% Done:

0%

Estimated time:
Deployment actions:

Description

I ran one of our subdomains through the google mobile friendly test because of a complaint about reduced traffic -- I thought it might be related to google's recent announcement on search rankings/mobile design

When I ran the test - http://www.google.com/webmasters/tools/mobile-friendly/?url=http%3A%2F%2Fapicciano.commons.gc.cuny.edu%2F - it appeared that the test was not loading the theme CSS (see screenshot) and that robots.txt was blocking the google bot.

Is this by any chance related to changes made here - http://redmine.gc.cuny.edu/issues/3890#note-4 ?

Files

Screen Shot 2015-03-12 at 5.12.31 PM.png (329 KB) Screen Shot 2015-03-12 at 5.12.31 PM.png Matt Gold, 2015-03-12 05:12 PM
Actions
Copy link
 #2

Updated by Boone Gorges over 9 years ago

  • Assignee changed from Boone Gorges to Matt Gold

It's not a problem with subdomains, it's a problem with overly restrictive robots.txt rules. I will change these rules, but first I need to have the robots.txt chowned back to the commons user - it's currently owned by root, so I can't modify it. Can you make the request, please?

chown commons:commons /var/www/html/robots.txt
Actions
Copy link
 #3

Updated by Boone Gorges over 9 years ago

  • Status changed from Assigned to Resolved
  • Target version set to Not tracked

I've made the necessary changes to allow googlebot access.

Actions
Copy link
 #4

Updated by Matt Gold over 9 years ago

Great -- thanks, Boone

Actions
Copy link

Also available in: Atom PDF