User-agent: * # Search Disallow: /search/ # Prevent crawling DFP tags Disallow: /359/ #Prevent crawling content with default url aliases Disallow: /content/ #Prevent crawling blaize datalayer Disallow: /blaize/datalayer Sitemap: https://www.theweek.co.uk/sitemap.xml