# /robots.txt file for http://ccdb.cropcircleresearch.com/ User-Agent: ia_archiver Disallow: / User-agent: * Disallow: /cc Disallow: /error Disallow: /i/ Disallow: /misc Disallow: /s