In webmater , i have added only my base url ,but the other pages are indexed. do i have to enter all pages manually to remove each page form google indexing? please suggest a solution?
1 Answer
Have you considered using a Robots.txt file to exclude the other pages from being crawled?
You can exclude individual pages or directories or everything:
user-agent: *
Disallow: /
Disallow: /products/*
See this answer for more explanation on excluding everything except the root