AR
Artsdata Crawler
GoodBotVerifiedBOTWeb crawler that collects publicly available LOD for arts and culture in Canada
Identification
Bot name
Artsdata Crawler
Category
Aggregator
Kind
BOT
Verification
Verified bot
Cloudflare slug
artsdata-crawler
User-agent patterns
artsdata-crawlerUser-agent string
artsdata-crawler
Block or allow Artsdata Crawler
Block it
Add a Disallow rule for artsdata-crawler in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block Artsdata Crawler from crawling your entire site User-agent: artsdata-crawler Disallow: / # Allow Artsdata Crawler full access User-agent: artsdata-crawler Allow: /
Allow & verify
Ensure your robots.txt allows artsdata-crawler. Verify requests by checking the user-agent string.
Traffic & trends
Cloudflare Radar traffic
No Cloudflare traffic data available.
Google Trends interest
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
CloudflareRadar
Last updated September 8, 2026
Something wrong with this entry? Suggest a correction