# Robots.txt file for control of search engine spiders on http://websites.greenspire.co.uk # # All robots will be treated the same apart from the googlebot, where we are # able to exclude *.js and *.css files. User-agent: * Disallow: /dpc/ Disallow: /js/ User-Agent: googlebot Disallow: /*.js$ Disallow: /*.css$