rexCrawler
rexCrawler is a regular expression web-crawler plugin. …
插件标签： crawler
Robots.txt Extender
Dynamic robots.txt for Multisite! Change parameters, or…
JaspreetChahal’s wordpress bot detector lite
This plugin detects a few bots (e.g. Google, Google ads…
SEObot Monitor for Googlebot, Bingbot and search engine spiders
With SEObot Monitor for Googlebot you will be able to d…
Page Modified
Display the results of your Page Modified crawls right …