User-agent: * Disallow: /readme.html Disallow: /wp-admin/ Disallow: /not-found/ Disallow: /terms-and-conditions/ Allow: /wp-admin/admin-ajax.php