User-agent: *
Disallow: /*/print$
# Don't allow indexing of search results
Disallow: /search?
# We only allow indexing of the licence-finder landing page
Disallow: /licence-finder/
Allow: /licence-finder
# We only allow indexing of the finance finder landing page
Disallow: /business-finance-support-finder/*
Allow: /business-finance-support-finder
Disallow: /apply-for-a-licence
# Prevent access to CMA cases until 31st March
Disallow: /cma-cases
Disallow: /cma-cases/
Sitemap: https://www.gov.uk/sitemap.xml
Crawl-delay: 0.5

User-agent: *
Disallow: /*/print$
# Don't allow indexing of search results
Disallow: /search?
# We only allow indexing of the licence-finder landing page
Disallow: /licence-finder/
Allow: /licence-finder
# We only allow indexing of the finance finder landing page
Disallow: /business-finance-support-finder/*
Allow: /business-finance-support-finder
Disallow: /apply-for-a-licence
Sitemap: https://www.gov.uk/sitemap.xml
Crawl-delay: 0.5

Allow CMA finders to be indexed
Allow CMA finders to be indexed

They are still blocked by X-Robots-Tag headers sent by
specialist-frontend and finder-frontend.
