Directory/Categories/Search Engine Crawler/AIWebIndex

AIWebIndex

GoodBotBotwhois.orgBOT

Indexes the public web; serves pages to AI agents as clean, attributed documents with a link back. No model training.

Operator website ↗

GoodBot

Assessment

Search Engine Crawler

Identification

Bot name

AIWebIndex

How we rated this bot

Identifies itself honestly, and we found no credible reports of abuse.

Names itself honestly

Yes

Verified by Cloudflare

Says it follows robots.txt and opt-outs

Not stated

Ignores site rules

None found

Disguises itself or evades blocks

None found

Overloads sites

None found

How widely people complain

No complaint about this bot in the evidence

Reddit discussion

There is no Reddit discussion of this bot in the evidence

What we read

Block or allow AIWebIndex

Block it

Add a Disallow rule for AIWebIndex/2.0 (+https://lyrenth.com/bot; AI-readable web index) in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block AIWebIndex from crawling your entire site
User-agent: AIWebIndex/2.0 (+https://lyrenth.com/bot; AI-readable web index)
Disallow: /

# Allow AIWebIndex full access
User-agent: AIWebIndex/2.0 (+https://lyrenth.com/bot; AI-readable web index)
Allow: /