Stopping crawling by search engines

• 

  echomikeromeo · Member · Apr 26, 2007 at 4:33 am

  • Copy link
  • Add topic to favorites

  I’ve checked the “I would like to block search engines, but allow normal visitors” option, and yet my blog still appears when I search for its title through Google. It’s been at least a month since I selected that option, so it’s not a question of Google having time to update its crawling habits. What can I do to remove my blog from search results ASAP?

• 

  timethief · Member · Apr 26, 2007 at 5:23 am

  • Copy link

  Suffice to say that you must immediately stop using category tags so your blog posts do not appear in the wordpress.com category tag pages.
  Google has cached your blog articles. You can take also take direct action to have them removed from the Google cache http://googlewebmastercentral.blogspot.com/2007/04/requesting-removal-of-content-from-our.html lorelle explains how to do this http://lorelle.wordpress.com/2007/04/22/how-to-remove-your-blog-content-from-google/
  Lastly note that Google is not the only search engine and that it frequently takes 3-4 months for their caches to be cleared as well.

• 

  echomikeromeo · Member · Apr 26, 2007 at 5:29 am

  • Copy link

  Thanks for your response. I don’t actually use the category system, though I’m now pursing the Google links. Hopefully that will help.

• 

  raincoaster · Member · Apr 26, 2007 at 5:45 am

  • Copy link

  Retroactively setting your blog as not indexable is not nearly as effective as setting it that way from the beginning. At this point not only Google but MSN, Yahoo, Ask.com, and all their overseas divisions such as .co.uk will have caches of your blog as well. You will have to contact them one by one and ask them to delete the caches, or simply wait it out for a few months until they vanish.

• 

  drmike · Member · Apr 26, 2007 at 1:56 pm

  • Copy link

  Older pages don’t get spidered that often which is why it takes a bit.