Todo es posible
Añade nuevas funciones o conecta tus herramientas favoritas con miles de plugins: disponibles en todos los planes de pago de WordPress.com.
crawlers
29 plugins
- Booter - Bots & Crawlers ManagerBooter - Bots & Crawlers Manager is a preventative measure (treatment in advance) and treatment of damages caused by crawlers and bots.
- Known Agents – Track AI Bots and Crawlers, Block Scrapers, Analyze LLM Referral TrafficTrack crawlers, scrapers, LLM assistants, and AI agents on your website. Generate a robots.txt that blocks AI bots. Formerly Dark Visitors.
- Block AI CrawlersTell AI (Artificial Intelligence) companies not to scrape your site for their AI products.
- Robots.txt rewriteProvide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.
- Marquee image crawlerMarquee image crawler is a continuous scrolling image plugin. This plugin crawls the images left or right.
- LLM Bot Tracker - AI Crawler Detection & AnalyticsAutomatically track ChatGPT, Claude, Perplexity & 56 AI bots crawling your WordPress site. Monitor AI search engine visits, detect AI web scrapers …
- Señales de contenido IAControla cómo los rastreadores de IA utilizan tu contenido con las señales de contenido de Cloudflare en el archivo robots.txt. Incluye la reserva de derechos prevista en la Directiva 2019/790 de la UE.
- Bot Traffic Shield - Block Bad Bots and Stop AI Bots CrawlersA powerful and user-friendly plugin to block AI crawlers and malicious data scraper bots, protecting your content and server resources.
- CodingBunny LLMs.txt GeneratorAdvanced llms.txt generator with AI metadata, Schema.org types, canonical URLs, and differentiated licenses for optimal LLM indexing.
- Robots Meta WhizEasy way to discourage search engines from indexing only specific pages / posts with custom meta tags.
- MetaRobots by SEO-SignThe easiest way to manage meta robots tag.
- Crawler RecordCrawler Record tells you the last time each of the most common search/chat bots visited (Google, ChatGPT, etc)- and the pages at which they looked.
- CeeWP Robots.txt ManagerEasily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!
- Copyright AI Content Licensing – Block AI Crawlers + Get PaidAI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.
- WoPo Web CrawlerGet content from other websites
- Traffic/Crawler网站蜘蛛/访客记录网站蜘蛛/访客记录,主要包含了各大搜索引擎的蜘蛛访问记录,以及网站的访问流量进行监控。
- Log-Hero.com PluginAnalyze how search engines and other bots crawl and understand your web page. The official PHP Wordpress plugin for log-hero.com.
- Seo Crawlytics Data Export & DeleteExports all entries of Seo Crawlytics and gives you the option to delete the entries that are older than 1 month.
- Serve MarkdownServe Markdown versions of your posts and pages to AI agents and crawlers. Content negotiation, .md URLs, auto-discovery, and crawler logging.
- Senthor – Protect Against AI CrawlersProtect your content from AI crawlers and monetize every request with Senthor. Real-time detection, crawler control, and detailed analytics.
