AppSupplyIndexBot
GoodBotVerifiedBOTA specialized crawler that fetches IAB Tech Lab standard files like app-ads.txt and sellers.json to verify digital advertising supply chains. Operated by App Supply Index.
What is AppSupplyIndexBot?
AppSupplyIndexBot is a focused crawler operated by the App Supply Index to maintain transparency in the digital advertising ecosystem. It exclusively targets specific industry-standard files, namely 'app-ads.txt' and 'sellers.json', to ensure that publishers and ad-tech vendors are correctly identified and authorized. The bot is designed to be lightweight and non-intrusive, operating on a weekly schedule and strictly adhering to robots.txt directives.
Identification
How we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
- robots.txt - Wikipedia
- Meta Has New Web-Crawling Bots That Sneakily Get Around Robots.txt - Business Insider
- OpenAI, Anthropic Ignore Rule That Prevents Bots Scraping Web Content - Business Insider
- The Major Companies and Media Outlets Blocking OpenAI's Crawler GPTBot - Business Insider
- AI-bot robots.txt blocker – ClassifAI
Why it crawls your site
The bot crawls to provide an automated, public index of advertising supply chain data, helping buyers verify the legitimacy of ad inventory. By reading these files, it helps identify potential fraud and ensures that advertising budgets are spent on authorized sellers. Operators can verify the bot's authenticity through its implementation of Web Bot Auth (RFC 9421), which provides cryptographically signed headers to confirm the request originates from the official App Supply Index infrastructure.
Block or allow AppSupplyIndexBot
Add a Disallow rule for AppSupplyIndexBot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block AppSupplyIndexBot from crawling your entire site User-agent: AppSupplyIndexBot Disallow: / # Allow AppSupplyIndexBot full access User-agent: AppSupplyIndexBot Allow: /
Ensure your robots.txt allows AppSupplyIndexBot. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction