Better Robots.txt – AI-Ready Crawl Control & Bot Governance icon

Better Robots.txt – AI-Ready Crawl Control & Bot Governance

by Pagup

View on WordPress.org
78 Quality Score
Active Installs
17/30

At 5,000 active installs, this is a niche plugin with a small but engaged user base, reflected in a moderate popularity score of 55.

Update Freshness
25/25

The plugin was updated in July 2026 and tested with WordPress 7.0, which signals very active maintenance and forward-looking compatibility.

User Rating
14/15

A 90 out of 100 rating from 102 reviewers indicates strong user satisfaction, even if the sample size is modest.

Support Health
8/15

With zero support threads recorded, there is no track record to evaluate responsiveness, which is a real concern for a paid Pro or Premium product.

WP Compatibility
15/15

Full marks here, requiring only WordPress 5.0 and PHP 7.4, making it compatible with virtually every modern WordPress installation.

Scores higher than 61% of indexed plugins

About

Replace the default WordPress robots.txt workflow with a smarter, structured version you can preview before publishing, with Free, Pro, and Premium ed …

Active Installs 5k+
Rating ★★★★½ 4.5/5
Last Updated 2026-09-18 7:04pm GMT
Requires WordPress 5.0+
Tested Up To 7.1.1
Requires PHP 7.4+

Security History

3 known vulnerabilities, all patched
1 High 2 Medium

Most recent: February 14, 2023

View details ▸

Powered by Wordfence Intelligence

What It Does

Better Robots.txt replaces the default WordPress robots.txt editor with a structured interface that lets you preview changes before they go live. It includes dedicated controls for blocking AI crawlers and generating an llms.txt file, a relatively new standard for guiding large language model bots. The plugin offers Free, Pro, and Premium editions for varying levels of bot governance.

Who It's For

This plugin is best for site owners who are actively concerned about AI bots scraping their content and want granular control without editing robots.txt manually. It suits publishers, bloggers, and small businesses running lean WordPress sites who want a focused, single-purpose tool rather than a full SEO suite. Developers managing client sites may also appreciate the preview-before-publish workflow.

Who Should Skip It

If you already use Yoast, Rank Math, AIOSEO, or SEOPress, those plugins include robots.txt editing features that may be sufficient. Anyone comfortable editing robots.txt directly via FTP or file manager does not need an extra plugin for this task.

The Bottom Line

Better Robots.txt delivers a focused, well-maintained solution for a specific and growing concern: managing AI bot access to your site. The 77.57 overall quality score is held back mainly by limited popularity and the absence of any support thread history. If AI crawler governance is a priority and you do not already use a full SEO plugin, this is a reasonable choice, but verify the developer's support responsiveness before buying Pro or Premium.

Tags

AI Crawlers bot blocker llms.txt robots.txt seo