Robots.txt file is not read in my website

• 

  shajel · Member · Oct 26, 2013 at 5:16 am

  • Copy link
  • Add topic to favorites

  Hello,

  I have an issue in robots.txt file uploaded in the root path of wordpress website. as it doesn’t reflect i disenabled the installation and installed WP robots1.1 version plugin. i had written Disallow all crawlers to access certain pages. but while checking i get page not found error.

  for example

  User-agent: *
  Disallow: /wp-admin/
  Disallow: /wp-includes/
  Disallow: /wp-content/
  Disallow: /wp-content/themes/
  Disalow: /wp-content/plugins/

  sitemap: http://www.example.com/abc/

  could you please give me suggestions to solve this issue.

  Thanks in Advance

• 

  supportbot · Member · Oct 26, 2013 at 5:16 am

  • Copy link

  You did not specify a blog address or reason for posting when you created this topic.

  This support forum is for blogs hosted at WordPress.com. If your question is about a self-hosted WordPress blog then you’ll find help at the WordPress.org forums.

  If you don’t understand the difference between WordPress.com and WordPress.org, you may find this information helpful.

  If you forgot to include a link to your blog, you can reply and include it below. It’ll help people to answer your question.

  This is an automated message.

• 

  auxclass · Member · Oct 26, 2013 at 6:14 am

  • Copy link

  You are in the wrong forum – see the supportbot above for more info