# go away ? tell all others not in the list below to stay out! User-agent: * Disallow: / # As of 01/29/2008, there are 13 crawlers welcomed by 2collab User-agent: bcdindexer Disallow: /landingpage Disallow: /register User-agent: CiteSeerBot Disallow: /landingpage Disallow: /register User-agent: FAST Disallow: /landingpage Disallow: /register User-agent: Googlebot Disallow: /landingpage Disallow: /register User-agent: gulliver Disallow: /landingpage Disallow: /register User-agent: ia_archiver Disallow: /landingpage Disallow: /register User-agent: Marvin Disallow: /landingpage Disallow: /register User-agent: MSNbot Disallow: /landingpage Disallow: /register Crawl-delay: 5 User-agent: msnbot Disallow: /landingpage Disallow: /register Crawl-delay: 5 User-agent: NimbleCrawler Disallow: /landingpage Disallow: /register User-agent: Slurp Disallow: /landingpage Disallow: /register Crawl-delay: 5 User-agent: Teoma Disallow: /landingpage Disallow: /register User-agent: zibber-v0.1(www.zibb.com/crawler/) Disallow: /landingpage Disallow: /register