1 Problem Statement:If a site is severed on both HTTP and HTTPS . For same content we have http and https URL crawled by Google.
Solutions: To Avoid duplicate content issue we should remove https URL from google index. To do the we will show different robots.txt content for HTTPS RewriteRule ^/robots.txt$ /robots_ssl.txt [PT,L] robots_ssl.txt content is given below User-agent: * Disallow: /
Solutions: To Avoid duplicate content issue we should remove https URL from google index. To do the we will show different robots.txt content for HTTPS RewriteRule ^/robots.txt$ /robots_ssl.txt [PT,L] robots_ssl.txt content is given below User-agent: * Disallow: /
No comments:
Post a Comment