# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: # Disallow: / User-Agent: ia_archiver Disallow: / User-Agent: * Disallow: /epost/ Disallow: /emails/ Disallow: /neighbourlinks/ Disallow: /favorites/ Disallow: /favoritter/ Disallow: /tips-en-venn/ Dísallow: /lost_password/ Disallow: /login/ Disallow: /signup/ Disallow: /mypage/ Disallow: /min-tinde/* Disallow: /session/ Disallow: /loancalcs/ Disallow: /sok/cooliris/* Disallow: /travel/auto_complete_for_airport_code_name_from Sitemap: http://www.tinde.no/sitemap/sitemap.xml