Skip to content
Directory/Categories/AI Crawler/YGS Group Falconer Scraper
YG

YGS Group Falconer Scraper

GoodBotVerifiedBOT

Falconer is an automated discovery platform operated by The YGS Group that monitors news and media coverage to provide brands with actionable intelligence and sentiment analysis. Operated by The YGS Group.

GoodBot
Assessment
AI Crawler
Category
BOT
Kind
1
Data sources
AI-generated summary, drawn from Cloudflare, operator docs, and community data

What is YGS Group Falconer Scraper?

Falconer is an 'always-on' discovery engine developed by The YGS Group to assist marketing and communications teams in tracking brand-relevant news. By utilizing adaptive crawling and machine learning, the platform identifies high-impact media coverage, filters out duplicate content, and scores stories based on relevance and sentiment. It is designed to transform raw news data into structured, actionable briefs that can be pushed directly into enterprise tools like Salesforce.

Helpful — It is a transparent, business-oriented crawler designed to help organizations track brand mentions and media coverage for professional communication strategies.

Identification

Bot name
YGS Group Falconer Scraper
Operator
The YGS Group
Category
AI Crawler
Kind
BOT
Verification
Verified bot
Cloudflare slug
ygs-group-falconer-scraper
User-agent patterns
ygs-scraper-bot
User-agent string
ygs-scraper-bot/1.0
Main use cases
Media monitoring and brand sentiment analysisAutomated content discovery for PR and marketing teamsIntegration of news insights into CRM systems like Salesforce

Why it crawls your site

The bot crawls the web to identify and extract mentions of a brand or specific topics from target publishers. It processes this data to provide users with timely alerts and context-rich summaries, enabling teams to react quickly to media coverage. Operators can verify the bot's activity by reviewing the official documentation at ygscontentlicensing.com/falconer/ or by checking the User-Agent string against the organization's published standards.

Block or allow YGS Group Falconer Scraper

Block it

Add a Disallow rule for ygs-scraper-bot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block YGS Group Falconer Scraper from crawling your entire site
User-agent: ygs-scraper-bot
Disallow: /

# Allow YGS Group Falconer Scraper full access
User-agent: ygs-scraper-bot
Allow: /
Allow & verify

Ensure your robots.txt allows ygs-scraper-bot. Verify requests by checking the user-agent string.

Traffic & trends

Cloudflare Radar traffic

No Cloudflare traffic data available.

Google Trends interest

Loading trend data…

Data sources

This profile is compiled from the following sources.

CloudflareRadar
Last updated July 26, 2026