June 3, 2008 - Comments Off on Robots.txt and the Sitemaps protocol

Robots.txt and the Sitemaps protocol

At Google I/O, I discovered you can add a line to your robots.txt file so that search bots can autodiscover your sitemaps built to the Sitemaps protocol. The format:

Sitemap: http://www.example.com/sitemap.xml

Jeffrey Barke is senior developer and information architect at theMechanism, a multimedia firm with offices in New York, London and Durban, South Africa.

Published by: jeffreybarke in The Programming Mechanism
Tags: ,

Comments are closed.