Robots.txt Crawl-delay: 3600

• 

  rusller · Member · Dec 31, 2015 at 12:58 pm

  • Copy link
  • Add topic to favorites

  Hello All WordPress Team,

  Please, i have some problems with the robots.txt with this variation in my blog.
  This function in Robots.txt :
  User-agent: IRLbot
  Crawl-delay: 3600

  Is marked ad warning on My google webmaster tools, how can i remove this from my website robots.txt file ?

  Thank you, and Happy new year 2016!

  Regards
  IL

  The blog I need help with is: (visible only to logged in users)