Adding AdsBot-Google #User-agent: AdsBot-Google #Allow: / Adding Googlebot #User-agent: Googlebot #Allow: / User-Agent: * #Security Team Recomendation : Start Disallow : /search?* Disallow : /search/?* #Security Team Recomendation : End Allow: /wp-content/uploads/ Disallow: /.htaccess Disallow: /php.ini Disallow: /wp-config.php Disallow: /wp-config.php Disallow: /nginx.conf Disallow: /wp/wp-content/plugins/ Disallow: /wp/wp-admin/ Disallow: /wp/wp-includes/ Disallow: /app/wp-content/plugins/ Disallow: /app/cache/ Disallow: /app/mu-plugins/ #Disallow: /app/themes/ Disallow: /app/w3tc-config/ Disallow: /app/debug.log Disallow: /app/advanced-cache.php Disallow: /app/.gitignore Disallow : */feed/ Sitemap: https://www.smartfren.com/sitemap_index.xml