Copied to clipboard

Flag this post as spam?

This post will be reported to the moderators as potential spam to be looked at


  • Matt Taylor 873 posts 2086 karma points
    May 16, 2014 @ 14:27
    Matt Taylor
    0

    Dynamic Robots.txt

    I was watching your video on configuring the SEO Checker.

    I noticed that when the Robots.txt was previewed the sitemap.xml line has been placed in the file.

    I've got the 'Enable XmlSitemap' and the 'Enable dynamic robots.txt file' options switched on but the Robots.txt file does not contain this line.

    Do I need to add it manually?

    If so, what does the 'Enable dynamic robots.txt file' option really do for you?

    Regards, Matt

  • Richard Soeteman 4035 posts 12842 karma points MVP
    May 16, 2014 @ 14:33
    Richard Soeteman
    0

    Hi Matt,

    This should be inserted by default indeed. When it isn't included by default then there is probably another robots.txt file on disk. SEOChecker checks for that and doesn't render its own robots.txt file.

    When you remove the robost.txt file from disk it should work automatically.

    Hope this helps,

    Richard

  • Matt Taylor 873 posts 2086 karma points
    May 16, 2014 @ 14:37
    Matt Taylor
    0

    Ah, yes. I do already have one at the root.

    So if I understand this correctly if I have one in the root SEO Checker will leave it alone?
    If I don't have one SEO Checker will create one with whatever entries it thinks it needs?

    Regards, Matt

  • Richard Soeteman 4035 posts 12842 karma points MVP
    May 16, 2014 @ 14:44
    Richard Soeteman
    100

    Hi Matt,

    Yes that is exactly how it works indeed. There are even some advanced options in case you want to modify it or use it in a multi-domain set-up. That is described in the manual.

    Best,

    Richard

  • Matt Taylor 873 posts 2086 karma points
    May 16, 2014 @ 16:12
    Matt Taylor
    0

    Yes, would have helped if I had read that bit in the documentation which explains it all.

    Thanks, Matt

Please Sign in or register to post replies

Write your reply to:

Draft