#--- this section is for all other search engines: User-agent: * # All other spiders should avoid Disallow: /cgi-bin/ Disallow: /djskrien/cs231/ Disallow: /djskrien/cs232/ Disallow: /djskrien/cs361/