Please, fix my robot.txt file

• 

  grigorynokhrin · Member · Jul 26, 2014 at 8:30 am

  • Copy link
  • Add topic to favorites

  I’m having trouble with my robots.txt file blocking all the searches. My site is

  muine.me

  and the robots file can be viewed at

  muine.me/robots.txt

  The problem is evident that bots are being disallowed and I cannot figure out how to change it. My privacy setting is set to visible for search engines and all the settings in webmaster tools for different searchers are right.

  The blog I need help with is: (visible only to logged in users)

• 

  grigorynokhrin · Member · Jul 26, 2014 at 8:32 am

  • Copy link

  ¯_(ツ)_/¯

• 

  amightywp · Member · Jul 27, 2014 at 9:57 am

  • Copy link

  Hi there,

  Your robots.txt file is actually correct for a site which has certain things allowed, but certain things which should not be indexed on a search engine (such as anything in your dashboard).

  A robots.txt file which has everything disallowed looks like this:

  # This file was generated on Sun, 27 Jul 2014 09:56:00 +0000
  User-agent: *
  Disallow: /

  I hope this helps!

• 

  grigorynokhrin · Member · Jul 27, 2014 at 10:24 am

  • Copy link

  So, there is no any problems with my robots.txt file?
  Is that good as it looks?

• 

  amightywp · Member · Jul 27, 2014 at 10:51 am

  • Copy link

  That is correct. That is how it should look in our system.

• 

  grigorynokhrin · Member · Jul 27, 2014 at 10:57 am

  • Copy link

  Oh, you know, now everything works fine!
  It’s looks like google robot just got holidays.
  Thank you, for your time.

• 

  amightywp · Member · Jul 27, 2014 at 11:31 am

  • Copy link

  No problem at all! Hope you enjoy your weekend!