# This directs automatic www robots, crawlers # and mappers to directories they may spider on anteex.wererat.net. User-agent: * Disallow: /images/ Disallow: /logs/ Disallow: /download/ Disallow: /zipfiles/ Disallow: /backgrounds/ Disallow: /sounds/ Disallow: /missing.html Disallow: /fobidden.html Disallow: /failed_auth.html Disallow: /internal_error.html Disallow: /scripts/ Disallow: /auctions/ Disallow: /stats/ Disallow: /texts/ Disallow: /cgi-bin/ User-agent: vscooter #AltaVista Image Search Disallow: / User-agent: ArribaPacketRat #Arriva Vista Disallow: / User-agent: ExcaliburInternetSpider #Yahoo Image Surfer Disallow: / User-agent: Googlebot-Image #Googlebot Image Search Disallow: / User-agent: psbot #Picsearch Disallow: / #Yahoo Image Surfer User-agent: Yahoo-MMCrawler Disallow: /