Conecte-se à possibilidade
Adicione novas funcionalidades ou conecte suas ferramentas favoritas com milhares de plugins — disponíveis em todos os planos pagos do WordPress.com.
crawlers
32 plugins
Booter - Bots & Crawlers ManagerBooter - Bots & Crawlers Manager is a preventative measure (treatment in advance) and treatment of damages caused by crawlers and bots.
Known Agents – Track AI Bots and Crawlers, Block Scrapers, Analyze LLM Referral TrafficTrack crawlers, scrapers, LLM assistants, and AI agents on your website. Generate a robots.txt that blocks AI bots. Formerly Dark Visitors.
Block AI CrawlersTell AI (Artificial Intelligence) companies not to scrape your site for their AI products.
Robots.txt rewriteProvide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.
Marquee image crawlerMarquee image crawler is a continuous scrolling image plugin. This plugin crawls the images left or right.
LLM Bot Tracker - AI Crawler Detection & AnalyticsAutomatically track ChatGPT, Claude, Perplexity & 56 AI bots crawling your WordPress site. Monitor AI search engine visits, detect AI web scrapers …
AI Content SignalsControl how AI crawlers use your content with Cloudflare Content Signals in robots.txt. Includes EU Directive 2019/790 rights reservation.
Bot Traffic Shield - Block Bad Bots and Stop AI Bots CrawlersA powerful and user-friendly plugin to block AI crawlers and malicious data scraper bots, protecting your content and server resources.
CodingBunny LLMs.txt GeneratorAdvanced llms.txt generator with AI metadata, Schema.org types, canonical URLs, and differentiated licenses for optimal LLM indexing.
Robots Meta WhizEasy way to discourage search engines from indexing only specific pages / posts with custom meta tags.
MetaRobots by SEO-SignThe easiest way to manage meta robots tag.
Crawler RecordCrawler Record tells you the last time each of the most common search/chat bots visited (Google, ChatGPT, etc)- and the pages at which they looked.
Warmer - Cache Warmer and Cache Preload CrawlerWarm your WordPress cache with scheduled crawling, cache preloading, URL source control, logs, diagnostics, and WP-CLI.
Serve MarkdownServe Markdown versions of your posts and pages to AI agents and crawlers. Content negotiation, .md URLs, auto-discovery, and crawler logging.
CeeWP Robots.txt ManagerEasily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
Traffic/Crawler网站蜘蛛/访客记录网站蜘蛛/访客记录，主要包含了各大搜索引擎的蜘蛛访问记录，以及网站的访问流量进行监控。
Copyright AI Content Licensing – Block AI Crawlers + Get PaidAI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.
WoPo Web CrawlerGet content from other websites
Seo Crawlytics Data Export & DeleteExports all entries of Seo Crawlytics and gives you the option to delete the entries that are older than 1 month.
ParseLessServe your posts as Markdown to AI crawlers and CLI tools — typically 95%+ less bandwidth, ~60–80% fewer DB queries, no theme bloat.