0

I am trying to delete a disallow condition from robots.txt file. This is not located in root or /pub directories.

I can't change it from admin panel because seems like Magento 2.3.0 has a bug on theme edit page.

Github thread for details

Thanks

  • Can you give robots.txt link here? – Shoaib Munir Feb 12 at 5:49
  • Sure, Here is the link mkelectronicsbd.com/robots.txt – Khaled Bin Amir Feb 12 at 5:51
  • From the look of your web source robots.txt should be in /pub directory. Please also check .htaccess, if robots.txt is somehow rewrite – Shoaib Munir Feb 12 at 6:05
  • I have created a new robots.txt file in root directory. newly created file now showing on website. I don't know why! – Khaled Bin Amir Feb 12 at 7:53
4

It seems your Nginx or Apache is set differently. Try locating the file in var directory. If you have SSH access, run below command to see if there is a robots file on server.

Check if there is a robots file on server locate -c robots.txt

If the result found is greater than 0, it means the file exists on the server. Next, you can run below command to find the location

locate robots.txt

  • Found some robots.txt files with this method but that file is missing. Now I have created a new robots.txt file in root directory. newly created file now showing on website. I don't know why! – Khaled Bin Amir Feb 12 at 7:53

Your Answer

By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

Not the answer you're looking for? Browse other questions tagged or ask your own question.