crawler

A lightweight plugin that protects email addresses from email-harvesting robots, by encoding them into decimal and hexadecimal entities.

Robots.txt for WordPress

Booter - Bots & Crawlers Manager is a preventative measure (treatment in advance) and treatment of damages caused by crawlers and bots.

All-in-One SEO plugin for Wordpress Robots.txt optimization with XML Sitemap detection (Yoast, Rank Math, ...), Woocommerce booster, Robots.

Spider Analyser是一款用于跟踪WordPress网站各种搜索引擎蜘蛛爬行日志的插件，并进行详细的蜘蛛爬行数据统计、蜘蛛行为分析、蜘蛛爬取分析及伪蜘蛛拦截等。

Prevent bots from creating accounts by blacklisting domains and usernames and present people with a human friendly security question.

Tell AI (Artificial Intelligence) companies not to scrape your site for their AI products.

Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.

Marquee image crawler is a continuous scrolling image plugin. This plugin crawls the images left or right.

Mass ping tool for SEO plugin is one of the fastest ways to get indexed by Google. After pinging, Google bots, crawlers will visit your website and in …

Blocks the archive.org bots through the WordPress virtual robots.txt file.

An easy-to-use plugin that generates and configures a proper robots.txt file, essential for effective search engine optimization (SEO).

Automatically track ChatGPT, Claude, Perplexity & 56 AI bots crawling your WordPress site. Monitor AI search engine visits, detect AI web scrapers …

Real-Time Bot Protection. Anti Bots (robots), crawlers and spiders also from botnets. Increase security and avoid server overload and bandwidth.

A powerful and user-friendly plugin to block AI crawlers and malicious data scraper bots, protecting your content and server resources.

Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file

Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt

Counts the visits from web spiders, crawlers and bots in your blog, with ability to get the blog rankings.

Automatically warm up your WordPress site's cache by crawling pages to ensure optimal performance for your visitors.

Blocks some Feed and Comment resources in order to avoid spam bots