I am working on this site and some how (I don't know why) Google stopstopped crawling Homethe home page URL (http://www.indusuno.com/http://www.indusuno.com/
), while checking this
When I search for the site in Google It, it shows (A"A description for this result is not available because of this site's robots.txt Learn more)more".
I'm attaching the snapshotscreenshot.
And also index.php
is coming in url which any one search on websiteresult URLs. Earlier we have blocked index.php
from robots.txt
, but now allow this.
Current contents of (indusunocom/robots.txt
):
Kindly help me to resolve this issue.
User-agent: *
Disallow: /checkout/
Disallow: /app/
Disallow: /lib/
Disallow: /pkginfo/
Disallow: /report/
Disallow: /var/
Disallow: /customer/
Disallow: /sendfriend/
Disallow: /review/
Disallow: /*SID=
Disallow: /catalogsearch/
Sitemap: https://www.indusuno.com/sitemap.xml