# For domain: http://www.spongettes.com # All robots will spider the domain User-agent: * # Disallow directory /directory name/ Disallow: /cgi-bin/ Disallow: /guest/ Disallow: /stats/ Disallow: /wwwboard/