User-agent: * Disallow: /admin/ Disallow: /agent/ Disallow: /availability/ Disallow: /cve/ Disallow: /owner/ Disallow: /send.php