# http://www.crush-bonjovi.com/robots.txt User-agent: * Disallow: /agents/ Disallow: /intern/ Disallow: /robots.txt Disallow: /changes.txt