# robots.txt for https://aelterman.be/ sitemap: https://aelterman.be/sitemaps-3-sitemap.xml sitemap: https://aelterman.be/fr/sitemaps-3-sitemap.xml sitemap: https://aelterman.be/en/sitemaps-3-sitemap.xml # live - don't allow web crawlers to index cpresources/ or vendor/ User-agent: * Disallow: /cpresources/ Disallow: /vendor/ Disallow: /.env Disallow: /cache/ Crawl-delay: 5 User-agent: ClaudeBot Disallow: /