indexing

• 

  tishrei · Member · Jul 12, 2011 at 1:34 am

  • Copy link
  • Add topic to favorites

  I have some posts that I do not wish to be indexed by any crawler, whether google, yahoo, etc. I have password protected those posts. My question is if I password protect a post, will that prevent any crawler from reading and/or indexing my password protected posts?

  Thanks,

  The blog I need help with is: (visible only to logged in users)

• 

  timethief · Member · Jul 12, 2011 at 3:08 am

  • Copy link

  Password protecting a post results in a robots.txt file that tells the spiders not to index it. http://www.google.com/support/forum/p/Webmasters/thread?tid=6737c28729891362&hl=en

• 

  auxclass · Member · Jul 12, 2011 at 3:16 am

  • Copy link

  The Post Title will be indexed but the content can not be reached by the search engines and if you do a search on the title you can probably find it but not the contents (unless you published it and then password protected it) I have a couple of password protected Posts on my site and I can find them in Google but not see the contents and if I click on the search link I just end up at the “enter the password” thing.

  If someone copies part of the Post and puts it on the internet then all bets are off.

• 

  tishrei · Member · Jul 12, 2011 at 3:46 am

  • Copy link

  Okay, thanks. That’s what I needed to know. If there was no way to prevent my posts from being indexed, then I was not going to post them. I don’t care about the title, it’s the CONTENT that I do NOT wish to have read by the spider bots.