插件标签： crawler
-
Email Address Encoder
A lightweight plugin that protects email addresses from email-harvesting robots, by encoding them into decimal and hexadecimal entities.
-
-
WordPress Robots.txt optimizer (+ XML Sitemap) – Boost SEO, Traffic & Rankings
All-in-One SEO plugin for Wordpress Robots.txt optimization with XML Sitemap detection (Yoast, Rank Math, …), Woocommerce booster, Robots.
-
Robots.txt rewrite
Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.
-
Advanced Robots.txt Optimizer & Editor
The "Advanced Robots.txt Optimizer & Editor" WordPress plugin enhances website functionality, SEO and traffic management by allowing use …
-
Marquee image crawler
Marquee image crawler is a continuous scrolling image plugin. This plugin crawls the images left or right.
-
Crawl Optimization
The Crawl Optimization Plugin is designed to help optimize your website’s crawl rate by removing unnecessary links and information from your HTTP head …
-
WordPress Meta Keywords
This plugin gives you the ability to set Meta Keywords in WordPress. Under pages it will registrate a separate taxonomy for keywords.
-
Mass Ping Tool for SEO – WordPress ping list to get indexed faster on Google, Yandex, …
Mass ping tool for SEO plugin is one of the fastest ways to get indexed by Google. After pinging, Google bots, crawlers will visit your website and in …
-
WordPress Meta Description
With this plugin you can control the text which will be shown as description on the search engine results pages.
-
Block Archive.org via WordPress robots.txt
Blocks the archive.org bots through the WordPress virtual robots.txt file.
-
DB Robots.txt
DB Robots.txt is an easy-to-use plugin for generating and configuring the file robots.txt that is essential for SEO (search engine optimization).
-
Stop and Block bots plugin Anti bots
Real-Time Bot Protection. Anti Bots (robots), crawlers and spiders also from botnets. Increase security and avoid server overload and bandwidth.
-
Block Chat GPT via robots.txt
Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file
-
bodi0`s Bots visits counter
Counts the visits from web spiders, crawlers and bots in your blog, with ability to get the blog rankings.
-
Block eCommerce Assets via robots.txt
Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt
-
Findkit – Site Search
Powerful cloud based search engine for your website. Search as you type, real-time index updates, and embeddable UI. Free for small websites.
-
-
Block Common Crawl via robots.txt
Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file
-
Block Feed and Comments via robots.txt
Blocks some Feed and Comment resources in order to avoid spam bots
