# Robots.txt file from http://www.searchengineworld.com # # All robots will spider the domain Sitemap: http://www.kralovske-spani.cz/sitemapindex.xml User-agent:* Crawl-delay: 100 Disallow: /getout.php Disallow: /cache/ Disallow: /design/ Disallow: /downoad/ Disallow: /emai/ Disallow: /extras/ Disallow: /htmlarea/ Disallow: /image/ Disallow: /images/ Disallow: /img/ Disallow: /includes/ Disallow: /media/ Disallow: /pub/ Disallow: /temp/