robot.txt file stopping me from getting ranked on google
-
I have already clicked the swith to show visibilty on search engines but keep getting blocked
# This file was generated on Sat, 07 Nov 2015 12:53:14 +0000
# If you are regularly crawling WordPress.com sites, please use our firehose to receive real-time push updates instead.
# Please see http://en.wordpress.com/firehose/ for more details.Sitemap: https://ghostwitter.wordpress.com/sitemap.xml
Sitemap: https://ghostwitter.wordpress.com/news-sitemap.xmlUser-agent: IRLbot
Crawl-delay: 3600User-agent: *
Disallow: /next/User-agent: *
Disallow: /mshots/v1/# har har
User-agent: *
Disallow: /activate/User-agent: *
Disallow: /public.api/# MT refugees
User-agent: *
Disallow: /cgi-bin/User-agent: *
Disallow: /wp-login.phpUser-agent: *
Disallow: /wp-admin/any help appreciated
The blog I need help with is: (visible only to logged in users)
-
your robots.txt file is set correctly – you have what looks like a 21 hour old site – it will not search very well as it takes 4 to 7 weeks for a new site to be fully indexed by search engines
http://ismyblogworking.com/ghostwitter.wordpress.com
The Disallow you see is normal – no reason for search engines to index your login page etc.
- The topic ‘robot.txt file stopping me from getting ranked on google’ is closed to new replies.