Indexed, though blocked by robots.txt
-
Hi!
Please I need help resolving this google search console error on my WordPress.com site
The error says some pages have been ‘Indexed, though blocked by robots.txt’.
Any help would be of great assistance.Thanks!
The blog I need help with is: (visible only to logged in users)
-
Hi there, a number of WordPressdotcom users are reporting this issue and you can read more about it in this thread: https://en.forums.wordpress.com/topic/google-reports-a-problem-with-the-robots-txt/
The short answer is that if you have set your site’s visibility to Public, Google is correctly crawling and indexing your site’s content.
-
Thank you so much for responding @justjennifer.
I have gone through the thread from the link you sent me. For mine, I tested the 2 pages having the error message and there was no part of the robots.txt that was blocking it. And they didn’t give me more information on what to do. Should I still ignore?
-
Hi there, I missed your reply. To the best of my knowledge, the areas mentioned in the Google reports are areas “behind the scenes” so people searching for your site don’t need them nor could they access them even if they appear in Google search results. The short answer, you can still ignore it.
If you have concerns that the areas are public facing pages you can add the links here.
For more information on “indexed, but blocked” here’s a link to Google’s own help pages. https://support.google.com/webmasters/answer/7440203?hl=en Scroll down to Warning
- The topic ‘Indexed, though blocked by robots.txt’ is closed to new replies.