Please, fix my robot.txt file
-
I’m having trouble with my robots.txt file blocking all the searches. My site is
muine.me
and the robots file can be viewed at
muine.me/robots.txt
The problem is evident that bots are being disallowed and I cannot figure out how to change it. My privacy setting is set to visible for search engines and all the settings in webmaster tools for different searchers are right.
The blog I need help with is: (visible only to logged in users)
-
-
Hi there,
Your robots.txt file is actually correct for a site which has certain things allowed, but certain things which should not be indexed on a search engine (such as anything in your dashboard).
A robots.txt file which has everything disallowed looks like this:
# This file was generated on Sun, 27 Jul 2014 09:56:00 +0000
User-agent: *
Disallow: /I hope this helps!
-
-
-
Oh, you know, now everything works fine!
It’s looks like google robot just got holidays.
Thank you, for your time. -
- The topic ‘Please, fix my robot.txt file’ is closed to new replies.