Mark Ferree - Open Source Web Development

Well maybe not greatness, but there are two files you can add to the root of your web directory that will greatly improve how Google, and the other search engines you may remember from 1999, index your site.

Sitemap.xml is the first file you'll learn to love. Search engines have finally gotten together and created a common format that lets you determine the relative importance of your individual pieces of content. This is done through a simple XML file, with each entry providing a link, a date modified, and a priority. This information gives Google's robots a "cheat sheet" to understanding the structure of your site. This is especially helpful if you've been ignoring web standards.

Robots.txt is the second step to SEO greatness. It can be though of as the opposite of sitemap.xml, instead of telling the search engine where to go, robots.txt tells it where not to go. This benefits everyone involved. You avoid the duplicate content penalty, increase your site's security, and Google doesn't waste its resources on content you don't want them to see.

These two files may not greatly improve your ranking tomorrow, but they definitely won't hurt it either. With the automated tools, and examples available on the web, there's no reason not to have them. Setting aside the SEO benefits, these files will make it easier for your users to find the content they need.