I've been looking around at different ecommerce websites and I noticed that a lot of them have the following meta information:


Magento only has the option to set pages as INDEX, FOLLOW, how would I add INDEX, ARCHIVE, FOLLOW as part of the options?


How can I add a seperate META for GOOGLEBOT or other specific bots to try and increase indexing?


1 Answer 1


Part 1

If you want set it from config you have to add an extension that sets another sourcemodel for for robots config section ...

                        <default_robots translate="label">
                            <!-- <source_model>adminhtml/system_config_source_design_robots</source_model> -->

Then your source model should extend Mage_Adminhtml_Model_System_Config_Source_Design_Robots and toOptionArray() could look like ...

public function toOptionArray()
    $options = parent::toOptionArray();
    $options[] = array('value'=>'NOARCHIVE', 'label'=>'NOARCHIVE');
    return $options;

Or you set it from your layout.xml ...

    <reference name="head">
        <action method="setRobots"><value>NOARCHIVE</value></action>

Part 2

The robots meta tag applies to all search engines, while the "googlebot" meta tag is specific to Google. (Source)

So this should work ... but you have to modify your head.phtml

<meta name="googlebot" content="..., ..." />

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.