User-agent: ASPSeek User-agent: asterias User-agent: baiduspider User-agent: Bizbot003 User-agent: BizBot04 kirk.overleaf.com User-agent: BravoBrian User-agent: CaliforniaBrownSpider User-agent: CyberSpyder (amant@www.cyberspyder.com) User-agent: dloader(NaverRobot) User-agent: Dumbot User-agent: EgotoBot User-agent: EI*Net/0.1 libwww/0.1 User-agent: EnigmaBot User-agent: Gaisbot User-agent: Generic User-agent: grub-client User-agent: HappyBot (gserver.kw.net) User-agent: heraSpider User-agent: http://www.almaden.ibm.com/cs/crawler User-agent: Ibot/1.0 libwww-perl/0.40 User-agent: InfoNaviRobot User-agent: ITI Spider User-agent: Jyxobot User-agent: Larbin User-agent: Libertech-Rover www.libertech.com? User-agent: linklooker User-agent: Merritt/1.0 User-agent: MSIECrawler User-agent: MyCNNSpider User-agent: NaverRobot User-agent: NexaBot User-agent: NPBot User-agent: obot User-agent: OGspider User-agent: OWR_Crawler User-agent: PhpDig User-agent: processor/0.0ALPHA libwww-perl/0.20 User-agent: psbot User-agent: puf User-agent: QuepasaCreep User-agent: rabaz User-agent: Reaper User-agent: RPT-HTTPClient User-agent: SandBot User-agent: ScoutAbout User-agent: semanticdiscovery User-agent: SlowBot User-agent: spyder3.microsys.com User-agent: StatFetcher/1.0 User-agent: Steeler User-agent: SummyCrawler User-agent: Surfbot User-agent: TeacherSoft/1.0 libwww/2.17 User-agent: Teleport Pro User-agent: TurnitinBot User-agent: TutorGig User-agent: vsecrawler User-agent: w3index User-agent: WebWalker User-agent: WhoWhere Robot User-agent: wobot/1.0 from 206.214.202.45 User-agent: WWW Collector User-agent: www.freeloader.com. Disallow: / User-agent: * Disallow: /webpics Disallow: /demos