User-agent: * Disallow: /bah-home/ Disallow: /get-certificate/ User-agent: rogerbot User-agent: mj12bot User-agent: dotbot User-agent: ahrefsbot Disallow: / User-agent: bingbot User-agent: msnbot Crawl-delay: 3 Sitemap: https://www.cybrary.it/assets/sitemap.txt Host: https://www.cybrary.it