User-agent: * Allow: / # Sitemap location Sitemap: https://www.concourse.ai/sitemap.xml # Disallow crawling of admin/private areas (if any) Disallow: /admin/ Disallow: /api/ Disallow: /private/ Disallow: /webinars/