#robots.txt This document excludes some areas from the robots #used by indexing engines # User-agent: * Disallow: /CGI/ Disallow: /cgi/