Skip to main content
edited body
Source Link

Creating and configuring robots.txt is very easy. You can create isit with simple text editor. find the best example here http://www.robotstxt.org/robotstxt.html that how to create robots.txt file.

Once you have created Robots.txt file it is supposed to submit at root directory of your webstore. For an example if your store domain is www.example.com you should put robots.txt file under the domain root where you also have app directory. So it sits and accessed like www.example.com/robots.txt

Creating and configuring robots.txt is very easy. You can create is with simple text editor. find the best example here http://www.robotstxt.org/robotstxt.html that how to create robots.txt file.

Once you have created Robots.txt file it is supposed to submit at root directory of your webstore. For an example if your store domain is www.example.com you should put robots.txt file under the domain root where you also have app directory. So it sits and accessed like www.example.com/robots.txt

Creating and configuring robots.txt is very easy. You can create it with simple text editor. find the best example here http://www.robotstxt.org/robotstxt.html that how to create robots.txt file.

Once you have created Robots.txt file it is supposed to submit at root directory of your webstore. For an example if your store domain is www.example.com you should put robots.txt file under the domain root where you also have app directory. So it sits and accessed like www.example.com/robots.txt

Source Link

Creating and configuring robots.txt is very easy. You can create is with simple text editor. find the best example here http://www.robotstxt.org/robotstxt.html that how to create robots.txt file.

Once you have created Robots.txt file it is supposed to submit at root directory of your webstore. For an example if your store domain is www.example.com you should put robots.txt file under the domain root where you also have app directory. So it sits and accessed like www.example.com/robots.txt