0

In webmater , i have added only my base url ,but the other pages are indexed. do i have to enter all pages manually to remove each page form google indexing? please suggest a solution?

1 Answer 1

0

Have you considered using a Robots.txt file to exclude the other pages from being crawled?

You can exclude individual pages or directories or everything:

user-agent: *
Disallow: /
Disallow: /products/*

See this answer for more explanation on excluding everything except the root

You can read more about Robots.txt files here

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.