BOTS crawling my web-log

• 

  tompowers51 · Member · Jul 28, 2021 at 5:07 pm

  • Copy link
  • Add topic to favorites

  I finally figured out from my stats that BOTS are crawling my weblog and harvesting (downloading) documents held in my Media file– without ‘clicking’ on the associated post). What are ‘they’ doing with these documents? Should I be worried about this activity? Is it actually helping my visibility in search results?

  Site: https://israelpalestineguide.wordpress.com.
  WP.com: Yes
  Correct account: Yes

• 

  staff-totoro · Staff · Jul 29, 2021 at 2:56 am

  • Copy link

  Hi there,

  When you host files online, anyone with a link to that file can download it without actually visiting your site. This is the case for media on all public websites (not just sites on WordPress.com) and is not something that you need to be particularly worried about unless you are trying to have the documents be secret and downloadable only by specific people.

  I would not say it helps your Search Engine Optimization (SEO) but doe snot hurt it either.

  Hope this helps!