Bot WHOIS
Submit a botLook up a bot
Directory/Categories/AI Crawler/YGS Group Falconer Scraper
The YGS Group logo

YGS Group Falconer Scraper

GoodBotVerifiedBOT

A content based scraper only for partners we collaborate with who have given permission to have their website scraped. Operated by The YGS Group.

GoodBot
Assessment
AI Crawler
Category
BOT
Kind
1
Data sources
AI-generated summary, drawn from Cloudflare, operator docs, and community data

What is YGS Group Falconer Scraper?

Falconer is an 'always-on' discovery engine developed by The YGS Group to assist marketing and communications teams in tracking brand-relevant news. By utilizing adaptive crawling and machine learning, the platform identifies high-impact media coverage, filters out duplicate content, and scores stories based on relevance and sentiment. It is designed to transform raw news data into structured, actionable briefs that can be pushed directly into enterprise tools like Salesforce.

Helpful — It is a transparent, business-oriented crawler designed to help organizations track brand mentions and media coverage for professional communication strategies.

Identification

Bot name
YGS Group Falconer Scraper
Operator
The YGS Group
Category
AI Crawler
Kind
BOT
Verification
Verified bot
Cloudflare slug
ygs-group-falconer-scraper
User-agent patterns
ygs-scraper-bot
User-agent string
ygs-scraper-bot/1.0
Main use cases
Media monitoring and brand sentiment analysisAutomated content discovery for PR and marketing teamsIntegration of news insights into CRM systems like Salesforce
Rated Sep 23, 2026 from public evidence

How we rated this bot

Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.

Names itself honestly
Yes
Verified by Cloudflare
Yes
Says it follows robots.txt and opt-outs
Not stated
Ignores site rules
None found
Disguises itself or evades blocks
None found
Overloads sites
None found
How widely people complain
No complaint about this bot in the evidence
Reddit discussion
There is no Reddit discussion of this bot in the evidence

What we read

Why it crawls your site

The bot crawls the web to identify and extract mentions of a brand or specific topics from target publishers. It processes this data to provide users with timely alerts and context-rich summaries, enabling teams to react quickly to media coverage. Operators can verify the bot's activity by reviewing the official documentation at ygscontentlicensing.com/falconer/ or by checking the User-Agent string against the organization's published standards.

Block or allow YGS Group Falconer Scraper

Block it

Add a Disallow rule for ygs-scraper-bot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block YGS Group Falconer Scraper from crawling your entire site
User-agent: ygs-scraper-bot
Disallow: /

# Allow YGS Group Falconer Scraper full access
User-agent: ygs-scraper-bot
Allow: /
Allow & verify

Ensure your robots.txt allows ygs-scraper-bot. Verify requests by checking the user-agent string.

Traffic & trends

Cloudflare Radar traffic

No Cloudflare traffic data available.

Google Trends interest

Loading trend data…

Links & references

The YGS Group documentation
ygscontentlicensing.com/falconer
↗
Cloudflare Radar: YGS Group Falconer Scraper
radar.cloudflare.com/traffic/bots/ygs-group-falconer-scraper
↗

Data sources

This profile is compiled from the following sources.

CloudflareRadar
Last updated November 1, 2026

Something wrong with this entry? Suggest a correction