User-agent: * Crawl-Delay: 5 Allow: /requirements/fullcalendar Allow: /requirements/prettify Sitemap: https://infratil.com/sites/infratil/sitemap.xml Disallow: /tasks/ Disallow: /requirements/ Disallow: /config/