Does WP censor posts?

• 

  jvtala · Member · Feb 13, 2011 at 8:29 pm

  • Copy link
  • Add topic to favorites

  Does wordpress censor posts? What i mean by this is, in my Google Webmaster Tools i have one post that it says is restricted by robots text with the URL of the post and in my sitemap. That post just so happens to be about the Berlin Wall (although not exclusively). Why would this post be restricted? I don’t understand what a robots text is anyway, so please excuse my ignorance if the answer is an obvious one. Thank you.

  The blog I need help with is: (visible only to logged in users)

• 

  thesacredpath · Member · Feb 13, 2011 at 9:08 pm

  • Copy link

  No, wordpress strongly believes in freedom of speech, so there is no censoring.

  What is the URL of the post that is supposedly restricted?

• 

  thesacredpath · Member · Feb 13, 2011 at 9:10 pm

  • Copy link

  I just looked at your robots.txt file, and there is nothing in it restricting any posts. It looks identical to the robots.txt file on my blog here.

• 

  jvtala · Member · Feb 13, 2011 at 9:12 pm

  • Copy link

  This is the post url (hope i’ve added it right)
  http://fortheloveofdan.wordpress.com/2011/02/03/berlin-1970s/
  I have 44 posts and this is the only one restricted, which is very curious.

• 

  thesacredpath · Member · Feb 13, 2011 at 9:21 pm

  • Copy link

  Google webmaster tools sometimes makes mistakes. This is the main content of your robots.txt file, and it just disallows search engines and bots from the administrative areas and sets some limits on how much time they can spend crawling your site at one time.

  User-agent: IRLbot
  Crawl-delay: 3600
  
  User-agent: *
  Disallow: /next/
  
  # har har
  User-agent: *
  Disallow: /activate/
  
  User-agent: *
  Disallow: /signup/
  
  User-agent: *
  Disallow: /related-tags.php
  
  # MT refugees
  User-agent: *
  Disallow: /cgi-bin/
  
  User-agent: *
  Disallow:

  I would suggest contacting staff and let them look around in the backend and see if they can come up with a reason. Otherwise as I said, I’ve seen GWMT make all sorts of mistakes. Normally the mistakes will correct over the span of a couple weeks or a month, but sometimes they do not.

• 

  jvtala · Member · Feb 13, 2011 at 9:27 pm

  • Copy link

  Thank you for all your help. I just checked again and it still says “url restricted by robots text” and in sitemap it says “unavailable” and it was updated yesterday. I’ll contact staff as you suggest, just in case there is a problem. Thanks again for your help and your time.

• 

  thesacredpath · Member · Feb 13, 2011 at 9:38 pm

  • Copy link

  You are welcome. I looked at your sitemap as well, and again, I see nothing out of the ordinary. That post is in the sitemap.

• 

  jvtala · Member · Feb 13, 2011 at 9:44 pm

  • Copy link

  Hmmm sounds like Google have lost the plot perhaps!…i have contacted staff though just in case. Cheers.

• 

  timethief · Member · Feb 13, 2011 at 9:53 pm

  • Copy link

  FWIW although Google has not indexed the post, it does appear in the WordPress.com Global Tag Pages. Example > http://en.wordpress.com/tag/berlin-1970s/

• 

  jvtala · Member · Feb 13, 2011 at 10:02 pm

  • Copy link

  At least that shows WP didn’t censor it then!! Why didn’t i have the sense to check Global Tags??? But i still have Google to wonder about! Cheers @timethief.