crawlers

Booter - Bots & Crawlers Manager is a preventative measure (treatment in advance) and treatment of damages caused by crawlers and bots.

Tell AI (Artificial Intelligence) companies not to scrape your site for their AI products.

Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.

Get realtime visibility into crawlers, scrapers, LLM assistants, and AI agents browsing your website. Generate a robots.txt to opt out of AI training.

Marquee image crawler is a continuous scrolling image plugin. This plugin crawls the images left or right.

Automatically track ChatGPT, Claude, Perplexity & 56 AI bots crawling your WordPress site. Monitor AI search engine visits, detect AI web scrapers …

A powerful and user-friendly plugin to block AI crawlers and malicious data scraper bots, protecting your content and server resources.

Easy way to discourage search engines from indexing only specific pages / posts with custom meta tags.

The easiest way to manage meta robots tag.

Advanced llms.txt generator with AI metadata, Schema.org types, canonical URLs, and differentiated licenses for optimal LLM indexing.

Add Content Signals to your robots.txt to control how AI crawlers can use your content.

Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!

网站蜘蛛/访客记录，主要包含了各大搜索引擎的蜘蛛访问记录，以及网站的访问流量进行监控。

Track, analyze, block or control AI crawler visits to your site. Monitor 50+ AI crawlers with blocking, robots.txt management, and llms.txt generation

AI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.

Get content from other websites

Analyze how search engines and other bots crawl and understand your web page. The official PHP Wordpress plugin for log-hero.com.

Exports all entries of Seo Crawlytics and gives you the option to delete the entries that are older than 1 month.

Crawler Record tells you the last time each of the most common search/chat bots visited (Google, ChatGPT, etc)- and the pages at which they looked.

It is a simple but effective plugin. Stops spam bots by checking browser content. You can also add an ip address to the blacklist.