Aktifkan berbagai kemungkinan
Tambahkan fitur baru atau hubungkan perangkat favorit Anda dengan ribuan plugin — tersedia pada semua paket WordPress.com berbayar.
crawlers
39 plugin
- AI Visibility Control – Dynamic llms.txt & robots.txt Crawler ControlManage AI crawler access. Block GPTBot, Claude & AI bots in robots.txt, generate dynamic llms.txt files, and track referral visits locally.
- Botpass - AI Crawler Optimizer, GEO & Entity OptimizationGEO for WordPress: make AI understand, trust & cite you. Serve clean Markdown, llms.txt & entity schema (JSON-LD), and score your AI visibility.
- Whizz MD — Markdown Endpoints for AI CrawlersServe every WordPress post and page as a clean .md file with full SEO frontmatter — discoverable by AI crawlers and search engines on the fly.
- Berq Markdown: Markdown Pages for AI & LLM CrawlersIncrease your AI visibility. Berq Markdown serves every page as a clean Markdown file so AI assistants and LLM crawlers can read, cite, and recommend …
- Temso AIStream front-end request logs from your WordPress origin to Temso so AI-crawler and bot traffic shows up in your dashboard.
- PufferSights - AI Crawler InsightsMonitor 100+ known AI crawler and AI agent user agents with local analytics, AI referrals, llms.txt, and opt-in robots.txt policy tools.
- Coywolf Robots.txt ManagerManage robots.txt from the WordPress admin: build rules, block bots by category, and serve a physical or virtual robots.txt.
- Aiso AI Crawler AnalyticsSee which AI assistants — ChatGPT, Claude, Perplexity, Google and more — crawl your site, broken down by assistant, crawler, purpose and page.
- BotSieve - AI Crawlers MonitorDetect ChatGPT, Claude, Meta AI and other AI crawlers visiting your WordPress website.
- ParseLessServe your posts as Markdown to AI crawlers and CLI tools — typically 95%+ less bandwidth, ~60–80% fewer DB queries, no theme bloat.
- Supertab ConnectConnect your WordPress site to the Supertab Connect platform for RSL license serving and enabling crawler authentication protocol.
- Serve MarkdownServe Markdown versions of your posts and pages to AI agents and crawlers. Content negotiation, .md URLs, auto-discovery, and crawler logging.
- BotkibbleServes every published post and page as Markdown for AI agents and crawlers. No configuration, no API keys. Activate and it works.
- OpenBotAuth – AI Crawler Access ControlVerify AI crawlers with HTTP Signatures and enforce allow/deny/teaser policies; also serves llms.txt and AI-ready feeds.
- WEO LLMS & AI Crawler GuideThe professional architect for your llms.txt file. Control how AI agents (ChatGPT, Claude, Perplexity) consume your website content with a structured, …
- AI Crawler GuardDetect and control AI crawler access with local logging and history.
- AI Content SignalsControl how AI uses your content — search, AI answers or training — via robots.txt Content Signals, HTTP headers, meta tags and TDMRep.
- CodingBunny LLMs.txt GeneratorAdvanced llms.txt generator with AI metadata, Schema.org types, canonical URLs, and differentiated licenses for optimal LLM indexing.
- AI Crawler and SEO Manager by akbansaThe AI Crawler and SEO Manager by akbansa plugin generates an llms.txt file for crawler discovery and logs visits by AI-based crawlers such as GPTBot, …
- Bot Traffic Shield - Block Bad Bots and Stop AI Bots CrawlersA powerful and user-friendly plugin to block AI crawlers and malicious data scraper bots, protecting your content and server resources.
