Title: Crawler Record Author: dizzysoft Published: 2025 年 9 月 16 日 Last modified: 2026 年 4 月 28 日 --- 搜索插件 ![](https://ps.w.org/crawler-record/assets/banner-772x250.png?rev=3362637) ![](https://ps.w.org/crawler-record/assets/icon-256x256.png?rev=3362637) # Crawler Record 作者：[dizzysoft](https://profiles.wordpress.org/dizzysoft/) [下载](https://downloads.wordpress.org/plugin/crawler-record.0.9.3.zip) * [详情](https://cn.wordpress.org/plugins/crawler-record/#description) * [评价](https://cn.wordpress.org/plugins/crawler-record/#reviews) * [安装](https://cn.wordpress.org/plugins/crawler-record/#installation) * [开发进展](https://cn.wordpress.org/plugins/crawler-record/#developers) [支持](https://wordpress.org/support/plugin/crawler-record/) ## 描述 **Crawler Record** logs the last time specific user agents (for search and AI chat/ LLMs) accessed your content including: * Google * Bing * ChatGPT (OpenAI) * Claude (Anthropic) * Perplexity * DuckDuckGo * Meta * Apple You can view this information: * **Admin page**: a grouped list of all crawlers, with last seen time, last page, and robots status for the crawler. * **Admin Bar (front-end)**: quick-glance status for the current singular or URL context (no dropdowns in wp-admin). * **Per Page/Post**: From the edit screen on any page or post, you can see that last time each crawler visited that page. * **Recent Pages**: From the admin page you can select a crawlwer and get a list of the recent pages this UA has visited. **Robots-aware:** The plugin checks your **robots.txt** and evaluates **Allow/Disallow** rules for a given path. If **Settings Reading “Discourage search engines”** is enabled, all agents are shown as blocked with a prominent warning. **Performance-friendly by design:** Write-throttling (default 10 minutes) and an auxiliary “last post ID per agent” record avoids heavy admin queries on large sites. **Privacy-friendly:** Saves only bot visit timestamps and last URLs crawled — no personal data. Learn [**how to use this plugin**](https://www.dizzysoft.com/crawler-record-plugin-for-wordpress/). #### Highlights * Supports common user-agent variants for Google, Bing, OpenAI (ChatGPT), Anthropic( Claude), Perplexity, Meta, Apple, and DuckDuckGo. * Robots status computed from local robots.txt (physical or virtual) without outbound requests. * Clear UI with grouped sections, microsecond timestamps, and a small diagnostics toggle showing the matched robots group and rule. #### Known limitations * Can only track crawlers from the time the plugin is installed- cannot look into the past. * robots.txt **wildcards** (`*`) and end-of-line marker (`$`) are **not** interpreted; matching is prefix-based only. Future versions may add full spec support. * To reduce database load and avoid slowing the website, bot tracking is throttled, so not every crawler visit will necessarily be recorded. ### Privacy This plugin stores: – **Timestamps** of crawler visits (float, with microseconds)–** Last URL** seen per crawler (per-URL records) – **Last post ID** per crawler (for admin performance) It does **not** collect or store personal data about site visitors. No data is transmitted to third parties. ### License GPLv2 or later. See LICENSE file. ## 安装 1. Upload the plugin folder to `/wp-content/plugins/`, or install via the admin Plugins screen. 2. Activate the plugin. 3. Visit **Crawler Record** under **Admin Crawler Record** to review crawler activity. ## 常见问题 ### Why are there no crawler visits recorded? This plugin can only begin to track crawler/bot visits from the time you have installed the plugun- not before. It may take several days or weeks (depending upon the popularity of your website) before any come for a visit. ### Why do I see “Blocked by WordPress setting”? If **Settings Reading Discourage search engines** is enabled, so none of these systems are allowed to read the pages on your site. ## 评价 ![](https://secure.gravatar.com/avatar/5468068da473b01ae2eef7026d1206415dc052db5a31a9cd841ab1a1a9222b8c? s=60&d=retro&r=g) ### 󠀁[Great plugin – Easy to use](https://wordpress.org/support/topic/great-plugin-easy-to-use-355/)󠁿 [triciaclements](https://profiles.wordpress.org/triciaclements/) 2026 年 1 月 22 日 Great plugin, does exactly what it says it will do and the developer is active and answers questions. I was concerned that LLM bots were being blocked from my site and this plugin shows they aren’t (or if any are being blocked) and also lets me know when specific bots visited my site and what page they visited. [ 阅读所有1条评价 ](https://wordpress.org/support/plugin/crawler-record/reviews/) ## 贡献者及开发者 「Crawler Record」是开源软件。 以下人员对此插件做出了贡献。 贡献者 * [ dizzysoft ](https://profiles.wordpress.org/dizzysoft/) [帮助将「Crawler Record」翻译成简体中文。](https://translate.wordpress.org/projects/wp-plugins/crawler-record) ### 对开发感兴趣吗? 您可以[浏览代码](https://plugins.trac.wordpress.org/browser/crawler-record/)，查看 [SVN仓库](https://plugins.svn.wordpress.org/crawler-record/)，或通过[RSS](https://plugins.trac.wordpress.org/log/crawler-record/?limit=100&mode=stop_on_copy&format=rss) 订阅[开发日志](https://plugins.trac.wordpress.org/log/crawler-record/)。 ## 更新日志 #### 0.9.2 * Added Recent Pages history for each crawler. * Added support for additional crawler variants including Google-Agent (mobile and desktop), Google-Extended, Bing (Search, Chat, and Copilot), Claude-SearchBot, Perplexity-User, DuckDuckGo AI, Applebot-Extended, and Meta-ExternalFetcher. * Improved crawler tracking for non-post frontend URLs such as archives, taxonomy pages, and other site URLs. * Improved site-wide reporting so the latest page visited by each crawler is more accurate. * Improved admin bar reporting for both singular content and non-singular frontend URLs. * Improved robots.txt reporting with clearer diagnostics showing the matched group and rule. * Added informational robots status handling for agents that may ignore or bypass robots.txt, such as Google-Agent and Meta-ExternalFetcher. * Improved handling of the WordPress “Discourage search engines” setting with clearer blocked-status warnings in the admin interface. * Improved storage of recent crawler activity with bounded recent-page history per agent. #### 0.9.1 * Fixed error on any WP archive pages (pages that list posts). #### 0.9.0 * Updated for WordPress 6.9 * Now monitoring for Meta and Apple User Agents * More accurate site-wide UA reporting. * Ensured video tutorial appears on all admin screens. * Fixed small code errors. #### 0.8.0 * Google updated its useragents so I updated the matching strings to account for these changes. #### 0.7.0 * The robots.txt checker wasn’t actually working. It does now. * When you look at the report in the admin section, the robots checker is looking for a site-wide rule; when you look at the back-end of a page, the robots checker is looking at that particular page. * If a page is blocked by the robots.txt file, a link appears sending you to the robots.txt file. * Added a video to explain how to use this plugin. #### 0.6.0 * Clarified distinction between Googlebots. * Better distinguishes Bingbots. * Cosmetic changes to page in admin section. * More clear documentation. #### 0.5.0 * First public release ## 额外信息 * 版本 **0.9.3** * 最后更新：**4 周前** * 活跃安装数量 **80+** * WordPress 版本 ** 6.0 或更高版本 ** * 已测试的最高版本为 **6.9.4** * PHP 版本 ** 7.4 或更高版本 ** * 语言 * [English (US)](https://wordpress.org/plugins/crawler-record/) * 标签 * [Bingbot](https://cn.wordpress.org/plugins/tags/bingbot/)[googlebot](https://cn.wordpress.org/plugins/tags/googlebot/) [gptbot](https://cn.wordpress.org/plugins/tags/gptbot/)[robots](https://cn.wordpress.org/plugins/tags/robots/) [seo](https://cn.wordpress.org/plugins/tags/seo/) * [高级视图](https://cn.wordpress.org/plugins/crawler-record/advanced/) ## 评级 5 星（最高 5 星）。 * [ 1 条 5 星评价 ](https://wordpress.org/support/plugin/crawler-record/reviews/?filter=5) * [ 0 条 4 星评价 ](https://wordpress.org/support/plugin/crawler-record/reviews/?filter=4) * [ 0 条 3 星评价 ](https://wordpress.org/support/plugin/crawler-record/reviews/?filter=3) * [ 0 条 2 星评价 ](https://wordpress.org/support/plugin/crawler-record/reviews/?filter=2) * [ 0 条 1 星评价 ](https://wordpress.org/support/plugin/crawler-record/reviews/?filter=1) [Your review](https://wordpress.org/support/plugin/crawler-record/reviews/#new-post) [查看全部评论](https://wordpress.org/support/plugin/crawler-record/reviews/) ## 贡献者 * [ dizzysoft ](https://profiles.wordpress.org/dizzysoft/) ## 支持 有话要说吗？是否需要帮助？ [查看支持论坛](https://wordpress.org/support/plugin/crawler-record/)