1. Home
2.  > 
3. Guide
4.  > 
5. How To
6.  > 
7. Editors
8.  > 
9. Admin
10.  > 
11. Search Engines

Search Engines

Control which content is available on search engines.

robots.txt

Use robots.txt to set site-wide rules. Note that credible search engines will follow these rules but these areas are still accessible to the public and can be indexed by bad agents. 

• In the repo, the template for the live site is saved as robots-live.txt.
• To upload to live site, use the Production toggle.
• Hide testing sites and non-public sites.

Individual Pages 

Hide or display individual pages with a page parameter. 

• Meta Robots [√] On is the default
• Uncheck (and publish) and the page will not display on credible search engines.  

Sitemap

Hide or display sections, pages, and folders from the sitemap with access. Note that "Exclude Search" in the access menu, excludes from OUCampus search, not search engine search.