EveryWeekBot
GoodBotVerifiedBOTCrawls public event listings from cultural venues for EveryWeek, a guide to what's on each week. Operated by EveryWeek.
What is EveryWeekBot?
EveryWeekBot is the dedicated crawler for the EveryWeek platform, a service focused on aggregating cultural event information for New York City and New Jersey. Unlike large-scale AI crawlers, this agent is purpose-built to identify and index public-facing event schedules and admission pages. It functions as a discovery engine, directing users back to the original venue websites rather than hosting proprietary content or training generative models.
Identification
How we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
- google ignoring robots.txt ? - Google Search Central Community
- I wonder if it will actually respect the robots.txt this time. | Hacker News
- How to deal with AI crawlers that ignore robots.txt | Soups Ranjan posted on the topic | LinkedIn
- Crawler without limits: Perplexity ignores robots.txt | heise online
- Meta Has New Web-Crawling Bots That Sneakily Get Around Robots.txt - Business Insider
Why it crawls your site
The bot crawls to maintain an up-to-date, comprehensive directory of cultural happenings, ensuring that users can find accurate event details and ticketing links. By visiting venue websites, it automates the discovery of new performances and exhibitions that might otherwise be difficult to track manually. Operators can verify the bot's identity through its documented user-agent string and the provided verification URL, which outlines its commitment to ethical crawling practices and respect for site-specific directives.
Block or allow EveryWeekBot
Add a Disallow rule for EveryWeekBot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block EveryWeekBot from crawling your entire site User-agent: EveryWeekBot Disallow: / # Allow EveryWeekBot full access User-agent: EveryWeekBot Allow: /
Ensure your robots.txt allows EveryWeekBot. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction