Diem blog syndication

Verify that your website is crawlable

Since the first open source release, 5.0.0, Diem allows to prevent search engine bots to crawl your website. By changing a setting in the admin menu: "Tools->Configuration->Configuration Panel", you can enable or disable search engine indexation for all pages:

It works by changing the "robots" meta value. This is usefull for keeping control of your SEO, especially when your website content is not fully ready for indexation.

However, until today, the "Site indexable" setting was set to false by default. This means that all your pages had robots meta "noindex,nofollow". In light of this you are strongly encouraged to check this setting and change it to true in order to make your website appear on search engines like Google.

Be aware that this setting is culture dependent. If your website is multilingual, you need to change the setting value for each culture.

Next versions of Diem (5.0.6, 5.1.2, 5.2) will have this setting set to true by default.

Add a comment


  • ThibaultMay 17, 2010 10:44 PM

    Thanks Ivan Plamenov Tanev for your help on finding the issue and writing the blog post!

  • Good Post overallMarch 4, 2016 6:02 AM

    That's a really nice information to know regarding the Site indexing status. Atleast I can have a thorough check towards my site http://www.genericapharmacy.net/

  • Europe-pharmacyApril 22, 2016 9:26 AM

    very nice information have to be share for site indexing thanks for this keep sharing such info go to my blog Generic Viagra Online http://www.europe-pharmacy.biz/

  • pillen-palastApril 22, 2016 11:39 AM

    It works by evolving the "robots" meta esteem. This is usefull for keeping control of your SEO, particularly when your site substance is not completely prepared for indexation. for go to my blog Kamagra http://www.pillen-palast.net/

  • AssertMedsJuly 18, 2017 11:01 AM

    Thanks for the article Thibault D! Making website crawlable is essential to improving SEO. Bots/spiders require to crawl your web pages carefully so that they’re indexed accurately by search engines and appear in search results. Regards, http://www.assertmeds.com/

  • SureViagraSeptember 12, 2017 12:52 PM

    Great tips over here! I will definitely add these tips..Keep sharing. http://www.sureviagra.com

Fork Diem on GitHub