Skip to content
Methodology

Content-Usage preferences

ia.content-usage · 1.10

Find MAY Recommendation

Why it matters

Content-Usage is an AIPREF working-group draft for declaring content-use preferences. It is descriptive preference metadata, not crawler access control.

How to fix it

Declare your content-use preferences with a Content-Usage rule in robots.txt or an HTTP header.

  1. Decide your preferences for the AIPREF categories, for example train-ai and search.

  2. Add a Content-Usage line to robots.txt, or send a Content-Usage header.

    User-agent: *
    Allow: /
    Content-Usage: train-ai=n, search=y

Verify

curl -sf https://{domain}/robots.txt

Expected: A Content-Usage line with valid AIPREF vocabulary

Run a new scan for this checkpoint:

isagentready results {domain} --checkpoint ia.content-usage
Details Mapping, lifecycle and references