# WSafe Training - Robots.txt # https://wsafetraining.com User-agent: * Allow: / # Allow search engine crawlers User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / # Sitemap location Sitemap: https://wsafetraining.com/sitemap.xml # Crawl-delay for respectful crawling Crawl-delay: 1 # Disallow admin and internal pages Disallow: /admin Disallow: /api/