Methodology
Each checkpoint has a stable id, a stage, a strength and an evidence type. The spec part tells what agents need. The scoring policy tells how we score it.
2026-10-22 Aligned with agentready.org spec 2.0
The spec
- Find
- Agents can reach the site and discover its pages.
- Read
- Agents can fetch and parse the content without JavaScript.
- Act
- Agents can finish tasks through forms, APIs, MCP and auth.
Checkpoints Grouped by stage
- robots.txt present AR-FIND-01 MUST
- AI crawler directives AR-FIND-01 MUST
- XML sitemap AR-FIND-03 SHOULD
- Meta robots / X-Robots-Tag AR-FIND-01 MUST
- Content freshness signals MAY
- HTTP bot accessibility AR-FIND-01 MUST
- Link response headers AR-FIND-04 AR-READ-06 MAY
- Content-Usage preferences MAY
- DNS-AID agent records MAY
- AI Catalog AR-FIND-04 MAY
- Developer docs discoverability AR-FIND-02 AR-READ-04 MAY
- Common Crawl presence Info
- Training crawler blocking AR-FIND-01 Info
- TDMRep declaration Info
- ai.txt policy Info
- Web Bot Auth Info
- llms.txt AR-READ-07 SHOULD
- Content negotiation (text/markdown) AR-READ-09 MAY
- Agent content contracts AR-READ-11 AR-ACT-01 MAY
- Soft-404 hygiene AR-READ-02 MUST
- First-party pricing page AR-READ-11 SHOULD
- JSON-LD present AR-READ-08 SHOULD
- Organization / WebSite schema AR-READ-08 SHOULD
- High-value schema types AR-READ-08 SHOULD
- Entity linking via @id AR-READ-08 SHOULD
- Schema validation AR-READ-08 SHOULD
- FAQPage schema AR-READ-08 SHOULD
- Author attribution AR-READ-08 SHOULD
- Trust anchor pages SHOULD
- Server-side rendered content AR-READ-01 AR-READ-03 MUST
- Heading hierarchy AR-READ-03 MUST
- Semantic HTML elements MUST
- Landmarks and ARIA SHOULD
- Image alt text MUST
- Language attribute MUST
- Descriptive link texts MUST
- Document title AR-READ-03 MUST
- aria-hidden misuse SHOULD
- Docs pages that answer AR-READ-04 AR-FIND-02 AR-READ-05 SHOULD
- HTTPS MUST
- HSTS MUST
- Content-Security-Policy MUST
- X-Content-Type-Options MUST
- X-Frame-Options / frame-ancestors MUST
- Referrer-Policy MUST
- AGENTS.md agent guide MAY
- Form label coverage SHOULD
- Form field autocomplete SHOULD
- Keyboard navigability SHOULD
- Button accessible names SHOULD
- Dynamic widget state SHOULD
- WebMCP declarative API AR-ACT-07 SHOULD
- A2A Agent Card AR-READ-06 MAY
- MCP discovery AR-ACT-03 AR-ACT-10 MAY
- OpenAPI / API docs AR-ACT-02 SHOULD
- agents.json MAY
- Declarative form quality AR-ACT-07 SHOULD
- Interactive surface coverage AR-ACT-07 SHOULD
- API Catalog (RFC 9727) AR-READ-06 AR-ACT-02 SHOULD
- Agent Skills index AR-ACT-06 MAY
- x402 payments AR-ACT-08 MAY
- MPP (x-payment-info) AR-ACT-08 MAY
- UCP AR-ACT-08 AR-READ-06 MAY
- ACP manifest AR-ACT-08 AR-READ-06 MAY
- AP2 AR-ACT-08 MAY
- OpenAPI actionability quality AR-ACT-02 SHOULD
- MCP server card quality AR-ACT-04 MAY
- Live OpenAPI verification AR-ACT-02 SHOULD
- Live MCP verification AR-ACT-03 SHOULD
- API error responses AR-ACT-02 SHOULD
- API rate-limit headers AR-ACT-02 MAY
- MCP Apps UI resources AR-ACT-05 MAY
- NLWeb ask endpoint AR-ACT-09 MAY
- Agent checkout AR-ACT-08 MAY
- SDKs and CLI AR-ACT-06 SHOULD
- Agent task access AR-ACT-10 MUST
- CORS MAY
- Tool definition security MAY
- Auto-submit risk MAY
- OAuth discovery AR-ACT-01 SHOULD
- OAuth protected resource AR-ACT-01 SHOULD
- Agent auth readiness AR-ACT-01 SHOULD
Strength and evidence How to read a checkpoint
- MUST
- Agents fail without it. Fix it first.
- SHOULD
- Agents work better with it. Most sites need it.
- MAY
- Useful for some sites. The standard is new.
- Info
- Policy information. It has no strength.
- Measured study
- A study measured the effect on agents.
- Scanner data
- Scanner data shows adoption or failure.
- Recommendation
- A standard or expert guidance only.
Strength is a spec value and does not change a score. Security headers have no AR practice. They are in Read as the trust baseline for a safe fetch.
agentready.org practices How our checkpoints map to the open spec
-
AR-FIND-01 Allow agents in robots.txt and bot protection MUST
AI crawler directives , HTTP bot accessibility , Meta robots / X-Robots-Tag , robots.txt present , Training crawler blocking
-
AR-FIND-02 Publish the answer as first-party docs SHOULD
-
AR-FIND-03 List pages in a sitemap.xml SHOULD
-
AR-FIND-04 Publish an AI Catalog and link it MAY
-
AR-READ-01 Fetchable without JavaScript MUST
-
AR-READ-02 Return real HTTP status codes MUST
-
AR-READ-03 Homepage in raw HTML SHOULD
Document title , Heading hierarchy , Server-side rendered content
-
AR-READ-04 Docs pages that answer SHOULD
-
AR-READ-05 Fenced code, language-tagged SHOULD
-
AR-READ-06 Well-known discovery files SHOULD
A2A Agent Card , ACP manifest , API Catalog (RFC 9727) , Link response headers , UCP
-
AR-READ-07 llms.txt SHOULD
-
AR-READ-08 JSON-LD SHOULD
Author attribution , Entity linking via @id , FAQPage schema , High-value schema types , JSON-LD present , Organization / WebSite schema , Schema validation
-
AR-READ-09 Markdown mirror MAY
-
AR-READ-11 Pricing on a first-party page SHOULD
-
AR-ACT-01 Auth an agent can finish SHOULD
Agent auth readiness , Agent content contracts , OAuth discovery , OAuth protected resource
-
AR-ACT-02 Public API with a machine-readable contract SHOULD
API Catalog (RFC 9727) , API error responses , API rate-limit headers , OpenAPI / API docs , Live OpenAPI verification , OpenAPI actionability quality
-
AR-ACT-03 MCP server SHOULD
-
AR-ACT-04 Server cards for pre-connection discovery MAY
-
AR-ACT-05 MCP Apps MAY
-
AR-ACT-06 SDKs and a CLI SHOULD
-
AR-ACT-07 WebMCP SHOULD
Interactive surface coverage , WebMCP declarative API , Declarative form quality
-
AR-ACT-08 Let agents pay MAY
ACP manifest , Agent checkout , AP2 , MPP (x-payment-info) , UCP , x402 payments
-
AR-ACT-09 NLWeb ask endpoint MAY
-
AR-ACT-10 An MCP server or a CLI MUST
Changelog
Version history Current version 2026-10-22
2026-10-22 Added seven checks for the agentready.org practices that the scanner did not cover: pricing page, MCP Apps, NLWeb ask, agent checkout, SDKs and CLI, agent task access and docs pages that answer. All seven are bonus or informational, so core scores do not change. The AR mapping, strength and evidence type are new metadata and do not change scores. Agent task access is MUST in the spec but bonus in the score until a benchmark cycle confirms it. Readiness profile scores can change by a few points, because the new bonus checkpoints count in those profiles. The headline score does not change.
2026-09-02 Made the semantic and discovery checks outcome relevant and retired three checkpoints with weak evidence.
- Revised
- robots.txt present , AI crawler directives , Content freshness signals , Link response headers , Content-Usage preferences , High-value schema types , Author attribution , Trust anchor pages , Heading hierarchy , Semantic HTML elements , Landmarks and ARIA , Descriptive link texts , Form label coverage , Form field autocomplete , API rate-limit headers , Developer docs discoverability , CORS
2026-08-29 Revised the FAQPage, interactive surface coverage and OpenAPI quality checks.
2026-08-27 Retired the WebMCP manifest checkpoints because no specification defines a manifest.
- Retired
- WebMCP manifest , Manifest tool schema quality
2026-08-25 Added soft-404 hygiene, DNS-AID, trust pages, page token budget, API errors, API rate limits and developer docs links.
2026-08-24 First versioned methodology with evidence tiers, score roles and readiness profiles.
- Introduced
- robots.txt present , AI crawler directives , XML sitemap , llms.txt , Meta robots / X-Robots-Tag , Content freshness signals , Content negotiation (text/markdown) , HTTP bot accessibility , Link response headers , Content-Usage preferences , AGENTS.md agent guide , Agent content contracts , JSON-LD present , Organization / WebSite schema , High-value schema types , Entity linking via @id , BreadcrumbList markup , Schema validation , FAQPage schema , Author attribution , Server-side rendered content , Heading hierarchy , Semantic HTML elements , Landmarks and ARIA , Image alt text , Language attribute , Descriptive link texts , Question-based headings , Form label coverage , Form field autocomplete , Keyboard navigability , Document title , Button accessible names , aria-hidden misuse , Dynamic widget state , WebMCP declarative API , WebMCP manifest , A2A Agent Card , MCP discovery , OpenAPI / API docs , agents.json , Declarative form quality , Manifest tool schema quality , Interactive surface coverage , API Catalog (RFC 9727) , Agent Skills index , x402 payments , MPP (x-payment-info) , UCP , ACP manifest , AP2 , OpenAPI actionability quality , MCP server card quality , Live OpenAPI verification , Live MCP verification , AI Catalog , HTTPS , HSTS , Content-Security-Policy , X-Content-Type-Options , X-Frame-Options / frame-ancestors , CORS , Referrer-Policy , Tool definition security , Auto-submit risk , OAuth discovery , OAuth protected resource , Agent auth readiness
Scoring policy
The score uses weights and points that are separate from the spec. Only core checkpoints change the overall score.
Weights and grades Version 2026-10-22
- AI Content Discovery
- 30%
- Content & Semantics
- 20%
- AI Search Signals
- 20%
- Agent Protocols
- 15%
- Security & Trust
- 15%
A+ 95+ / A 80+ / B 70+ / C 40+ / D 20+ / F 0+
Profile checkpoint mapping Which checkpoints count toward each readiness profile
- AI search visibility
- Scored: 1.1 , 1.2 , 1.3 , 1.4 , 1.5 , 1.6 , 1.7 , 1.8 , 1.9 , 1.10 , 1.11 , 1.12 , 1.13 , 1.15 , 2.1 , 2.2 , 2.3 , 2.4 , 2.6 , 2.7 , 2.8 , 2.9 , 3.1 , 3.2 , 3.3 , 3.5 , 3.6 , 3.7 , 3.12
- Informational, no score effect: 4.26
- Browser agent usability
- Scored: 1.13 , 3.1 , 3.2 , 3.3 , 3.4 , 3.5 , 3.6 , 3.7 , 3.9 , 3.10 , 3.11 , 3.12 , 3.13 , 3.14 , 3.15 , 5.1 , 5.3 , 5.4 , 5.5 , 5.6 , 5.9
- Informational, no score effect: 4.1 , 4.7 , 4.9 , 5.11
- API and tool readiness
- Scored: 1.9 , 1.12 , 1.13 , 1.14 , 4.3 , 4.4 , 4.5 , 4.10 , 4.11 , 4.17 , 4.18 , 4.19 , 4.20 , 4.21 , 4.22 , 4.23 , 4.24 , 4.25 , 4.28 , 4.29 , 4.30 , 5.1 , 5.3 , 5.4 , 5.5 , 5.6 , 5.7 , 5.9 , 5.12 , 5.13 , 5.14
- Informational, no score effect: 4.1 , 4.6 , 4.7 , 4.9 , 4.26 , 5.10