Robots.txt file

• 

  wanderro · Member · Mar 14, 2019 at 3:19 pm

  • Copy link
  • Add topic to favorites

  The robots.txt file of my WordPress website automatically changes, although I had nothing to do with it. This prevents Google bots from crawling and indexing my website. Please help!

  The blog I need help with is: (visible only to logged in users)

• 

  rinazrina · Member · Mar 14, 2019 at 4:47 pm

  • Copy link

  Hi,

  I’ve just checked your robots.txt and everything looks normal and standard for wordpress.com sites. The directive there does not prevent Googlebot from crawling or indexing your site.

  If you see that your site hasn’t been indexed or shows in the Google search result, please give it more time for search engines to find your site since I see that your site is relatively new and only have few posts. I would suggest posting more content and verify your site to Google Search Console if you haven’t already.

  Please find more tips about search engines on this support article: https://en.support.wordpress.com/search-engines/

  Let me know if you have any further questions.

  Rina