What options do you have to block or lock General Crawlers?

  • Unknown's avatar

    In my stats General Crawlers constitutes at least 10 to 20% of visits / page views. What measures or plug ins do you have to prevent this?

    The blog I need help with is: (visible only to logged in users)

  • Unknown's avatar

    Hi Andrea,

    You can discourage search engines from crawling and indexing your site in your site’s Reading Settings, but it’s up to those crawlers to respect that setting. However, our team also works to accurately reflect your site’s real visitors and views in your stats.

    Can you point to a particular day or period of time where you see the traffic indicating a crawler on your site? That will help me look into this for you.

  • Unknown's avatar

    Hi Rachel, thank you for the information. The WordPress-blog I need help with is secondavita.de, hosted by 1und1.de. Only yesterday I counted at least 30 Hits. Thank you.

  • Unknown's avatar

    Hi Andrea,

    Thank you for clarifying. Since your blog at secondavita.de isn’t hosted here at WordPress.com or using the Jetpack plugin, the stats there aren’t connected to WordPress.com (so there’s nothing our team can do to affect those).

    If you’re concerned about the stats on that site, I’d recommend installing Jetpack and activating the WordPress.com Stats module. That way you can take advantage of the work we do at WordPress.com to manage your stats.

    If you’re interested in finding other solutions, I’d recommend posting in the WordPress.org forums for more tips about how to manage the stats on that self-hosted WordPress site. :)

  • Unknown's avatar

    Hi Rachel,

    I was afraid of that …;-) So, first I´ll try it with Jetpack an WP-Stats, otherwise I like to contact you again. Thank´s for all.

  • Unknown's avatar

    You’re welcome! If you have any trouble with Jetpack please let me know, or you can contact our Jetpack support team for more help. :)

  • The topic ‘What options do you have to block or lock General Crawlers?’ is closed to new replies.