A description for this result is not available because of this site's robots.txt

• 

  tweedbbq · Member · Oct 12, 2015 at 10:37 am

  • Copy link
  • Add topic to favorites

  When this url is found in google the message returned is ‘A description for this result is not available because of this site’s robots.txt ‘ however, on the free version i’m unable to modify the robots file. I’ve said to allow search engines to index but not sure what else to do. Any help you be greatly appreciated.

  The blog I need help with is: (visible only to logged in users)

• 

  micawbr · Member · Oct 13, 2015 at 1:07 am

  • Copy link

  If you recently changed your site from private to public, then you need to wait on Google to stop by and notice the change.

  Just now I did a search for c2eewwf6.wordpress.com and saw three pages listed in Google. All of them had proper descriptions.

• 

  misamisami · Member · Oct 23, 2015 at 2:20 am

  • Copy link

  i have the same problem here is my robots.txt file :
  # This file was generated on Wed, 21 Oct 2015 21:27:17 +0000
  User-agent: *
  Disallow: /wp-login.php

  User-agent: *
  Disallow: /

• 

  micawbr · Member · Oct 23, 2015 at 2:40 am

  • Copy link

  @misamisami – When your site is private or you’ve selected “discourage search engines from indexing this site” under Settings > Site Visibility, the robots.txt file looks like what you’ve posted.

  Today, I checked your site’s robots.txt file it’s set to allow search engines. Now you just need to wait on Google to come back around and update their index with your content.

• 

  ageofrevolutions · Member · Nov 20, 2015 at 2:28 pm

  • Copy link

  I am having the same problem with my site ageofrevolutions.com. It has been made public for quite some time now.

• 

  spookycrisp · Member · Nov 20, 2015 at 2:53 pm

  • Copy link

  The crawlers can take anywhere from days to weeks to stop by your blog.