Bug 4755 - robots.txt mostly excludes google from indexing the website
Summary: robots.txt mostly excludes google from indexing the website
Status: RESOLVED FIXED
Alias: None
Product: Website
Classification: Infrastructure
Component: web-structure (show other bugs)
Version: unspecified
Hardware: x86 Multiple
: Undecided normal
Target Milestone: ---
Assignee: Melissa Anderson
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2013-06-20 18:13 UTC by Holger Freyther
Modified: 2013-06-25 15:41 UTC (History)
3 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Holger Freyther 2013-06-20 18:13:29 UTC
Searching for Yocto documentation turns out to be difficult. A search for "Poky environment-setup" points to the ancient o-hand documentation but not to the Yocto website. Searching "Yocto ADT Manual" gives a google page that says that the robots.txt prevents google from indexing the page.

Looking at the robots.txt I see a "Disallow: /" which might explain it.
Comment 1 Paul Eggleton 2013-06-25 15:22:26 UTC
I think Michael has fixed this already after I discussed it with him directly -  Michael, can you confirm?
Comment 2 Michael Halstead 2013-06-25 15:41:43 UTC
https://www.yoctoproject.org/robots.txt was was copied over from the development server during the last security update set on June 5th. Fixed at 2013-06-20 16:00.