Robots.TXT Error, Google Console

  • Unknown's avatar

    I recently made some changes to my blog, during which point I had it set to private. Unfortunately, after reinstating it weeks ago, Google Search Console is still showing multiple errors saying the site’s Robots.txt is blocking them from accessing (and subsequently indexing) my blog’s pages- even after I’ve submitted updated sitemaps, among other things.

    Apparently this isn’t an uncommon problem. The question is: How do I fix it… Or, more correctly: Can any of the CS Staff fix it for me- especially when I can’t directly access the Robots.txt file to correct it myself on a free .COM blog.

    The blog I need help with is: (visible only to logged in users)

  • Hi there,

    This is normal. If your site has been private for a while it will have been removed from Google’s index, and it can take up to eight weeks for Google and other search engines to re-index it after you make it public again – longer if you’re not regularly publishing new posts, and it appears you’ve only started publishing again this week after you made the site public again four weeks ago.

    Make sure you publish regularly, and Google will re-index your site.

    But there is nothing that needs to be fixed. Your site’s robots.txt file is visible at https://yeslittlehummingbird.wordpress.com/robots.txt, and it is not blocking search engines. You’re getting that error in Search Console because Google hasn’t checked for an update to that file since you’ve set the site back to public. That’s not something we can fix from this end.

  • Unknown's avatar

    Thanks

  • The topic ‘Robots.TXT Error, Google Console’ is closed to new replies.