关于robots.txt 增加屏蔽内容

• 

  mydwnews · Member · Oct 16, 2018 at 2:58 am

  • Copy link
  • Add topic to favorites

  管理员您好：
  由于网站页面自动加载分页会造成URL的错误，从而增加404页面。现想把分页数URL屏蔽掉，请问如何添加到robots中去？ 错误网址：https://mydwnews.wordpress.com/category/%E5%8F%B0%E6%B9%BE%E6%96%B0%E9%97%BB/page/70/

  The blog I need help with is: (visible only to logged in users)

• 

  staff-zara · Staff · Oct 17, 2018 at 2:51 am

  • Copy link

  Hi there,

  Your question translates to:

  Hello administrator: Since the website page automatically loads the paging, it will cause a URL error, thus increasing the 404 page. Now I want to block the page number URL. How do I add it to the robots? Error URL: https://mydwnews.wordpress.com/category/%E5%8F%B0%E6%B9%BE%E6%96%B0%E9%97%BB/page/70/

  I’m able to access the URL without seeing a HTTP 404 page. To answer your question, you’re not able to edit the robot.txt file for sites hosted on WordPress.com.