# Directories to be ignored by all robots User-agent: * Disallow: /adv/ Disallow: /bill/ Disallow: /cgi-bin/ Disallow: /com/ Disallow: /control/ Disallow: /directory/cgi-bin/add.cgi Disallow: /dl/ Disallow: /invoice/ Disallow: /list/ Disallow: /mailinglist/ Disallow: /mill/ Disallow: /payment/ Disallow: /pics/ Disallow: /pm/ Disallow: /pubs/ Disallow: /scripts/ Disallow: /sites/ Disallow: /sounds/ Disallow: /statz/ Disallow: /tags/ Disallow: /temp/ Disallow: /webmail/ # Rover is a bad dog User-agent: Roverbot Disallow: /