Flex your site’s features with plugins
Add new functionality and integrations to your site with thousands of plugins.
crawlers
24 plugins
Booter - Bots & Crawlers ManagerBooter - Bots & Crawlers Manager is a preventative measure (treatment in advance) and treatment of damages caused by crawlers and bots.
Block AI CrawlersTell AI (Artificial Intelligence) companies not to scrape your site for their AI products.
Robots.txt rewriteProvide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.
Dark Visitors – Bot & AI Agent Analytics, Robots.txt Generator & Blocker, LLM Referral TrackerGet realtime visibility into crawlers, scrapers, LLM assistants, and AI agents browsing your website. Generate a robots.txt to opt out of AI training.
Marquee image crawlerMarquee image crawler is a continuous scrolling image plugin. This plugin crawls the images left or right.
LLM Bot Tracker - AI Crawler Detection & AnalyticsAutomatically track ChatGPT, Claude, Perplexity & 56 AI bots crawling your WordPress site. Monitor AI search engine visits, detect AI web scrapers …
Bot Traffic Shield - Block Bad Bots and Stop AI Bots CrawlersA powerful and user-friendly plugin to block AI crawlers and malicious data scraper bots, protecting your content and server resources.
Robots Meta WhizEasy way to discourage search engines from indexing only specific pages / posts with custom meta tags.
MetaRobots by SEO-SignThe easiest way to manage meta robots tag.
AI Content SignalsAdd Content Signals to your robots.txt to control how AI crawlers can use your content.
CodingBunny LLMs.txt GeneratorAdvanced llms.txt generator with AI metadata, Schema.org types, canonical URLs, and differentiated licenses for optimal LLM indexing.
Traffic/Crawler网站蜘蛛/访客记录网站蜘蛛/访客记录，主要包含了各大搜索引擎的蜘蛛访问记录，以及网站的访问流量进行监控。
CeeWP Robots.txt ManagerEasily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
Seo Crawlytics Data Export & DeleteExports all entries of Seo Crawlytics and gives you the option to delete the entries that are older than 1 month.
Copyright AI Content Licensing – Block AI Crawlers + Get PaidAI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.
Crawler RecordCrawler Record tells you the last time each of the most common search/chat bots visited (Google, ChatGPT, etc)- and the pages at which they looked.
WoPo Web CrawlerGet content from other websites
Log-Hero.com PluginAnalyze how search engines and other bots crawl and understand your web page. The official PHP Wordpress plugin for log-hero.com.
crawler-hunterIt is a simple but effective plugin. Stops spam bots by checking browser content. You can also add an ip address to the blacklist.
LJPL Armored robots.txtAdd some directives to your robots.txt file to keep your site safer