# Robots.txt for Pixelbar Hosted Web Site # Disallow Spider User-agent: ABCdatos BotLink Disallow: / User-agent: Arachnophilia Disallow: / User-agent: Arale Disallow: / User-agent: Araneo Disallow: / User-agent: AraybOt Disallow: / User-agent: Aretha Disallow: / User-agent: ARIADNE Disallow: / User-agent: AURESYS Disallow: / User-agent: unnamed Disallow: / User-agent: BBot Disallow: / User-agent: Big Brother Disallow: / User-agent: BlackWidow Disallow: / User-agent: Bloodhound Disallow: / User-agent: Borg-Bot Disallow: / User-agent: bright.net caching robot Disallow: / User-agent: CACTVS Chemistry Spider Disallow: / User-agent: Cassandra Disallow: / User-agent: Digimarc Marcspider/CGI Disallow: / User-agent: Checkbot Disallow: / User-agent: ChristCrawler.com Disallow: / User-agent: churl Disallow: / User-agent: cIeNcIaFiCcIoN.nEt Disallow: / User-agent: CMC/0.01 Disallow: / User-agent: Collective Disallow: / User-agent: Combine System Disallow: / User-agent: XYLEME Robot Disallow: / User-agent: Internet Cruiser Robot Disallow: / User-agent: CyberSpyder Link Test Disallow: / User-agent: CydralSpider Disallow: / User-agent: DeWeb(c) Katalog/Index Disallow: / # Disallow indexing of specific file extensions User-agent: * Disallow: /cgi-bin/ Disallow: /phpMyAdmin/ # Disallow Collectors and Spam User-agent: atSpider Disallow: / User-agent: cherrypicker Disallow: / User-agent: DSurf Disallow: / User-agent: EliteSys Entry Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: Mail Sweeper Disallow: / User-agent: munky Disallow: / User-agent: Roverbot Disallow: / User-agent: WebEmailExtrac Disallow: / # Disallow Offline Browsers User-agent: xGet Disallow: / User-agent: wGet Disallow: / User-agent: WebWalk Disallow: / User-agent: webvac Disallow: / User-agent: WebReaper Disallow: / User-agent: WebMirror Disallow: / User-agent: WebFetcher Disallow: / User-agent: WebCopy Disallow: / User-agent: webcopier Disallow: / User-agent: WebCatcher Disallow: / User-agent: WebBandit Disallow: / User-agent: w3mir Disallow: / User-agent: vobsub Disallow: / User-agent: Templeton Disallow: / User-agent: ssearcher100 Disallow: / User-agent: SpiderBot Disallow: / User-agent: Shai'Hulud Disallow: / User-agent: PBWF Disallow: / User-agent: LightningDownload Disallow: / User-agent: KDD Exploror Disallow: / User-agent: Jeeves Disallow: / User-agent: Internet Explore Disallow: / User-agent: InfoSpiders Disallow: / User-agent: httrack Disallow: / User-agent: HavIndex Disallow: / User-agent: GetUrl Disallow: / User-agent: GetBot Disallow: / User-agent: ESIRover Disallow: / User-agent: Download Wonder Disallow: / User-agent: Collage Disallow: / User-agent: Mozilla/2.0 (compatible; MS FrontPage 4.0) Disallow: /