robots.txt editing

• 

  samuelgerovoi · Jäsen · 24 huhtikuun, 2023 at 8:04 pm

  • Kopioi linkki
  • Add topic to favorites

  Hi,
  I need help editing my sites robots.txt. My site is blocked and I need to edit my robots.txt file.
  # If you are regularly crawling WordPress.com sites, please use our firehose to receive real-time push updates instead.
  # Please see https://developer.wordpress.com/docs/firehose/ for more details.

  Sitemap: https://ikkunatpuhtaiksi.wordpress.com/sitemap.xml
  Sitemap: https://ikkunatpuhtaiksi.wordpress.com/news-sitemap.xml

  User-agent: *
  Disallow: /wp-admin/
  Allow: /wp-admin/admin-ajax.php
  Disallow: /wp-login.php
  Disallow: /wp-signup.php
  Disallow: /press-this.php
  Disallow: /remote-login.php
  Disallow: /activate/
  Disallow: /cgi-bin/
  Disallow: /mshots/v1/
  Disallow: /next/
  Disallow: /public.api/

  # This file was generated on Mon, 24 Apr 2023 20:02:44 +0000

  I think I should put this somewhere but I dont know where…

  WP.com: Yes
  Jetpack: No
  Correct account: Yes

  Blogini: (visible only to logged in users).