# /robots.txt file for http://www.comparemyagent.com/ # mail webmaster@comparemyagent.com for constructive criticism User-agent: webcrawler Disallow: User-agent: * Disallow: /admin Disallow: /agent Disallow: /PHPMyAdmin Disallow: /SpryAssets