# www.robotstxt.org/ # www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449 User-agent: GPTBot Disallow: / User-agent: CCBot Disallow: / User-agent: * Crawl-delay: 10 Disallow: /api Disallow: /redirect Disallow: /logout Disallow: /login Disallow: /register Disallow: /opener-reload-and-window-close Disallow: /showMore Disallow: /autocomplete Disallow: /image_gallery/ Disallow: /tracking/image_gallery/ Disallow: /artikel-arkiv Disallow: /sonata/ Sitemap: https://www.berlingske.dk/sitemap.xml Sitemap: https://www.berlingske.dk/sitemap.xml/news