Indexed, though blocked by robots.txt

  • Unknown's avatar
    doctorfoxsister · Member ·

    I am getting a message from Google Search Console about one of my posts. The error says:
    Indexed, though blocked by robots.txt: The page was indexed, despite being blocked by robots.txt (Google always respects robots.txt, but this doesn’t help if someone else links to it). This is marked as a warning because we’re not sure if you intended to block the page from search results. If you do want to block this page, robots.txt is not the correct mechanism to avoid being indexed. To avoid being indexed you should either use ‘noindex’ or prohibit anonymous access to the page using auth. You can use the robots.txt tester to determine which rule is blocking this page. Because of the robots.txt, any snippet shown for the page will probably be sub-optimal. If you do not want to block this page, update your robots.txt file to unblock your page.
    I’m not sure how to unblock the page or post. I appreciate any help.
    My wordpress blog is thesupernaturalfoxsisters.com

  • staff-totoro · Staff ·

    Hi there,

    We are not able to support Google Search Console questions as this is a tool created by another company. We do allow you to “connect” your WordPress.com site to GSC, but if you have questions about how to use their webmaster tools, you will want to ask that here: https://support.google.com/webmasters

    Have you tried their tool for removing pages from the search index, as described here? https://support.google.com/webmasters/answer/9689846

    Hope this points you in the right direction

  • The topic ‘Indexed, though blocked by robots.txt’ is closed to new replies.