WordPress.org

Yorùbá

Wa WordPress jáde
WordPress.org

Plugin Directory

Àmì Plugin: crawler

Àmì Plugin: crawler

  • Email Address Encoder

    (160 àpapọ̀ àwọn ìbò)

    A lightweight plugin that protects email addresses from email-harvesting robots, by encoding them into decimal and hexadecimal entities.

    Till Krüss 100,000+ àwọn ìgbéwọlẹ̀ tó ṣiṣẹ́ Dánwò pẹ̀lú 6.7.4

  • Robots.txt Editor

    (8 àpapọ̀ àwọn ìbò)

    Robots.txt for WordPress

    Processby 10,000+ àwọn ìgbéwọlẹ̀ tó ṣiṣẹ́ Dánwò pẹ̀lú 5.6.16

  • AI-Ready & LLM-Optimized WordPress Robots.txt (+ Sitemaps) – Boost SEO, Traffic & AI Rankings

    (102 àpapọ̀ àwọn ìbò)

    All-in-One SEO plugin for Wordpress Robots.txt optimization with XML Sitemap detection (Yoast, Rank Math, …), Woocommerce booster, Robots.

    Pagup 6,000+ àwọn ìgbéwọlẹ̀ tó ṣiṣẹ́ Dánwò pẹ̀lú 6.8.3

  • Spider Analyser – WordPress搜索引擎蜘蛛分析插件

    (1 àpapọ̀ àwọn ìbò)

    Spider Analyser是一款用于跟踪WordPress网站各种搜索引擎蜘蛛爬行日志的插件，并进行详细的蜘蛛爬行数据统计、蜘蛛行为分析、蜘蛛爬取分析及伪蜘蛛拦截等。

    wbolt.com 4,000+ àwọn ìgbéwọlẹ̀ tó ṣiṣẹ́ Dánwò pẹ̀lú 6.8.3

  • No-Bot Registration

    (27 àpapọ̀ àwọn ìbò)

    Prevent bots from creating accounts by blacklisting domains and usernames and present people with a human friendly security question.

    Arnan de Gans 2,000+ àwọn ìgbéwọlẹ̀ tó ṣiṣẹ́ Dánwò pẹ̀lú 6.9

  • Robots.txt rewrite

    (2 àpapọ̀ àwọn ìbò)

    Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.

    Eugen Bobrowski 1,000+ àwọn ìgbéwọlẹ̀ tó ṣiṣẹ́ Dánwò pẹ̀lú 4.7.31

  • Marquee image crawler

    (1 àpapọ̀ àwọn ìbò)

    Marquee image crawler is a continuous scrolling image plugin. This plugin crawls the images left or right.

    gopiplus 800+ àwọn ìgbéwọlẹ̀ tó ṣiṣẹ́ Dánwò pẹ̀lú 6.1.9

  • Mass Ping Tool for SEO – WordPress ping list to get indexed faster on Google, Yandex, …

    (3 àpapọ̀ àwọn ìbò)

    Mass ping tool for SEO plugin is one of the fastest ways to get indexed by Google. After pinging, Google bots, crawlers will visit your website and in …

    Pagup 600+ àwọn ìgbéwọlẹ̀ tó ṣiṣẹ́ Dánwò pẹ̀lú 6.9

  • Block Archive.org via WordPress robots.txt

    (0 àpapọ̀ àwọn ìbò)

    Blocks the archive.org bots through the WordPress virtual robots.txt file.

    apasionados 500+ àwọn ìgbéwọlẹ̀ tó ṣiṣẹ́ Dánwò pẹ̀lú 6.7.4

  • Bisteinoff SEO Robots.txt

    (4 àpapọ̀ àwọn ìbò)

    An easy-to-use plugin that generates and configures a proper robots.txt file, essential for effective search engine optimization (SEO).

    Denis Bisteinov 500+ àwọn ìgbéwọlẹ̀ tó ṣiṣẹ́ Dánwò pẹ̀lú 6.9

  • Stop and Block bots plugin Anti-bots

    (2 àpapọ̀ àwọn ìbò)

    Real-Time Bot Protection. Anti Bots (robots), crawlers and spiders also from botnets. Increase security and avoid server overload and bandwidth.

    Bill Minozzi 300+ àwọn ìgbéwọlẹ̀ tó ṣiṣẹ́ Dánwò pẹ̀lú 6.9

  • bodi0`s Bots visits counter

    (5 àpapọ̀ àwọn ìbò)

    Counts the visits from web spiders, crawlers and bots in your blog, with ability to get the blog rankings.

    Budiony Damyanov 100+ àwọn ìgbéwọlẹ̀ tó ṣiṣẹ́ Dánwò pẹ̀lú 6.1.9

  • Block Chat GPT via robots.txt

    (1 àpapọ̀ àwọn ìbò)

    Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file

    apasionados 100+ àwọn ìgbéwọlẹ̀ tó ṣiṣẹ́ Dánwò pẹ̀lú 6.3.7

  • Block eCommerce Assets via robots.txt

    (0 àpapọ̀ àwọn ìbò)

    Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt

    apasionados 100+ àwọn ìgbéwọlẹ̀ tó ṣiṣẹ́ Dánwò pẹ̀lú 6.3.7

  • Warmer

    (3 àpapọ̀ àwọn ìbò)

    Automatically warm up your WordPress site's cache by crawling pages to ensure optimal performance for your visitors.

    Atakan Oz 60+ àwọn ìgbéwọlẹ̀ tó ṣiṣẹ́ Dánwò pẹ̀lú 6.8.3

  • Findkit – Site Search

    (0 àpapọ̀ àwọn ìbò)

    Powerful cloud based search engine for your website. Search as you type, real-time index updates, and embeddable UI. Free for small websites.

    Findkit Team 50+ àwọn ìgbéwọlẹ̀ tó ṣiṣẹ́ Dánwò pẹ̀lú 6.9.0

  • Block Common Crawl via robots.txt

    (0 àpapọ̀ àwọn ìbò)

    Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file

    apasionados 30+ àwọn ìgbéwọlẹ̀ tó ṣiṣẹ́ Dánwò pẹ̀lú 6.3.7

  • Block Feed and Comments via robots.txt

    (0 àpapọ̀ àwọn ìbò)

    Blocks some Feed and Comment resources in order to avoid spam bots

    apasionados 30+ àwọn ìgbéwọlẹ̀ tó ṣiṣẹ́ Dánwò pẹ̀lú 6.3.7

  • rexCrawler

    (0 àpapọ̀ àwọn ìbò)

    rexCrawler is a regular expression web-crawler plugin. Able to parse websites, save data and show them on pages.

    Lars.D.Rasmussen 10+ àwọn ìgbéwọlẹ̀ tó ṣiṣẹ́ Dánwò pẹ̀lú 3.0.5

  • AI Deny

    (1 àpapọ̀ àwọn ìbò)

    Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.

    Code For Broke 10+ àwọn ìgbéwọlẹ̀ tó ṣiṣẹ́ Dánwò pẹ̀lú 6.9