# This file lists local URLs that well-behaved robots should ignore # this identifies the wayback machine User-agent: ia_archiver Disallow: / User-agent: * Disallow: /admin/ Disallow: /cgi-bin/ Disallow: /board/ Disallow: /data/ Disallow: /webstats/ Disallow: /data4010433/ Disallow: /new/ Disallow: /members/