Plug into possibility
Add new features or connect your favorite tools with thousands of plugins — available on all paid WordPress.com plans.
crawler
56 プラグイン
Email Address EncoderA lightweight plugin that protects email addresses from email-harvesting robots, by encoding them into decimal and hexadecimal entities.
Robots.txt EditorRobots.txt for WordPress
No-Bot RegistrationPrevent bots from creating accounts by blacklisting domains and usernames and present people with a human friendly security question.
Known Agents – Track AI Bots and Crawlers, Block Scrapers, Analyze LLM Referral TrafficTrack crawlers, scrapers, LLM assistants, and AI agents on your website. Generate a robots.txt that blocks AI bots. Formerly Dark Visitors.
Block AI CrawlersTell AI (Artificial Intelligence) companies not to scrape your site for their AI products.
Robots.txt rewriteProvide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.
LLM Bot Tracker - AI Crawler Detection & AnalyticsAutomatically track ChatGPT, Claude, Perplexity & 56 AI bots crawling your WordPress site. Monitor AI search engine visits, detect AI web scrapers …
Marquee image crawlerMarquee image crawler is a continuous scrolling image plugin. This plugin crawls the images left or right.
Mass Ping Tool for SEO – Wordpress ping list to get indexed faster on Google, Yandex, …Mass ping tool for SEO plugin is one of the fastest ways to get indexed by Google. After pinging, Google bots, crawlers will visit your website and in …
Block Archive.org via WordPress robots.txtBlocks the archive.org bots through the WordPress virtual robots.txt file.
Bot Traffic Shield - Block Bad Bots and Stop AI Bots CrawlersA powerful and user-friendly plugin to block AI crawlers and malicious data scraper bots, protecting your content and server resources.
Bisteinoff SEO Robots.txtAn easy-to-use plugin that generates and configures a proper robots.txt file, essential for effective search engine optimization (SEO).
Block Chat GPT via robots.txtBlocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file
Block eCommerce Assets via robots.txtBlocks some WooCommerce assets and Search pages that should not be indexed through robots.txt
bodi0`s Bots visits counterCounts the visits from web spiders, crawlers and bots in your blog, with ability to get the blog rankings.
Crawler RecordCrawler Record tells you the last time each of the most common search/chat bots visited (Google, ChatGPT, etc)- and the pages at which they looked.
Warmer - Cache Warmer and Cache Preload CrawlerWarm your WordPress cache with scheduled crawling, cache preloading, URL source control, logs, diagnostics, and WP-CLI.
AI DenyEasily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.
Findkit - Site SearchPowerful cloud based search engine for your website. Search as you type, real-time index updates, and embeddable UI. Free for small websites.
Block Common Crawl via robots.txtBlocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file