Agency Analytics Crawler
GoodBotVerifiedBOTA web crawler by Agency Analytics that allows their clients to check their own sites for SEO Operated by Agency Analytics.
What is Agency Analytics Crawler?
Agency Analytics Crawler is a web crawler operated by Agency Analytics. A web crawler by Agency Analytics that allows their clients to check their own sites for SEO
Identification
aa/1.0How we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
- Google just added a crawler that ignores robots.txt — Suganthan
- A new web crawler launched by Meta last month is quietly scraping the internet for AI training data
- Crawler without limits: Perplexity ignores robots.txt | heise online
- Google-Agent Ignores robots.txt — What Actually Blocks It
- ChatGPT's Fetch Bot Ignores Robots.txt. Now What?
Why it crawls your site
Agency Analytics Crawler crawls websites to analyze search engine optimization factors and backlinks. It is operated by Agency Analytics as part of their SEO analysis infrastructure. If you see this bot in your server logs, it is a verified crawler and generally safe.
Block or allow Agency Analytics Crawler
Add a Disallow rule for aa/1.0 in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block Agency Analytics Crawler from crawling your entire site User-agent: aa/1.0 Disallow: / # Allow Agency Analytics Crawler full access User-agent: aa/1.0 Allow: /
Ensure your robots.txt allows aa/1.0. Verify requests are genuine by checking the user-agent string and referring to Agency Analytics's documentation.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction