TTD Content
GoodBotVerifiedBOTThe Trade Desk crawler classifies webpage content to allow advertisers to choose where they show ads. Operated by The Trade Desk.
What is TTD Content?
TTD Content is a web crawler operated by The Trade Desk. The Trade Desk crawler classifies webpage content to allow advertisers to choose where they show ads.
Identification
TTD-ContentHow we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
- I wonder if it will actually respect the robots.txt this time. - Hacker News
- google ignoring robots.txt ? - Google Search Central Community
- Robots.txt as a Lever for AI Accountability
- Meta Has New Web-Crawling Bots That Sneakily Get Around Robots.txt - Business Insider
- OpenAI, Anthropic Ignore Rule That Prevents Bots Scraping Web ...
Why it crawls your site
TTD Content crawls websites to collect data for advertising and marketing purposes. It is operated by The Trade Desk as part of their advertising infrastructure. If you see this bot in your server logs, it is a verified crawler and generally safe.
Block or allow TTD Content
Add a Disallow rule for TTD-Content in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block TTD Content from crawling your entire site User-agent: TTD-Content Disallow: / # Allow TTD Content full access User-agent: TTD-Content Allow: /
Ensure your robots.txt allows TTD-Content. Verify requests are genuine by checking the user-agent string and referring to The Trade Desk's documentation.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
From the community
Recent Reddit discussion mentioning this bot.
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction