User-agent: * Disallow: User-agent: bingbot Crawl-delay: 10 User-agent: oBot Crawl-delay: 600 User-agent: GrapeshotCrawler Crawl-delay: 600 User-agent: proximic Crawl-delay: 600