AG
Aggregator
38 botsBots that collect and republish content or metadata from across many sites.
About Aggregator bots
Aggregator bots pull together content, listings, or metadata from many sites into a single product - news readers, price comparisons, and similar services. Whether to allow one depends on whether the aggregation sends value back to your site.
Aggregator
Bots in this category
Every crawler and agent we classify as Aggregator. Click through for identification, IP ranges, and block rules.
Bot · OperatorCategorySentimentTraffic · 14d
AI
AirsoftdbBot
Airsoftdb
Aggregator
GoodBot
—
›
AR
Artsdata Crawler
Canadian Heritage Information Network (CHIN)
Aggregator
GoodBot
—
›
BE
BestChange Bot
BestChange
Aggregator
GoodBot
—
›
BO
BoardGamePrices Bot
KP Software Consult ApS
Aggregator
GoodBot
—
›
CA
Capital One Bot
Capital One
Aggregator
GoodBot
—
›
CO
CoostiBot
Unknown operator
Aggregator
GoodBot
—
›
DR
DrugCardBot
Unknown operator
Aggregator
GoodBot
—
›
EP
Epivoz Crawler
Techmeme
Aggregator
GoodBot
—
›
FN
FN Legislative and Regulatory Bot
Unknown operator
Aggregator
GoodBot
—
›
FA
Factset_spyderbot
Factset
Aggregator
GoodBot
—
›
FE
FedReporter Bot for FFIEC
Fed Reporter, Inc.
Aggregator
GoodBot
—
›
GE
GeedoShopProductFinder
Unknown operator
Aggregator
GoodBot
—
›
GH
GhostExplore
Unknown operator
Aggregator
GoodBot
—
›
HE
HelloWork
HelloWork Group
Aggregator
GoodBot
—
›
ID
Idealo
Idealo internet GmbH
Aggregator
GoodBot
—
›
IN
IndeedJobBot
Indeed
Aggregator
GoodBot
—
›
MA
MagnetmeBot
Magnet.me
Aggregator
GoodBot
—
›
ME
MediaMonitoringBot
MediaMonitoringBot
Aggregator
GoodBot
—
›
ME
Mediatoolkitbot
Determ
Aggregator
GoodBot
—
›
ME
MelonMesa Bot
MelonMesa
Aggregator
GoodBot
—
›
MI
MirrorWebCrawler
MirrorWeb Ltd
Aggregator
GoodBot
—
›
MO
MotoMinerBot
Motominer
Aggregator
GoodBot
—
›
NE
New York Times Newsgathering
The New York Times
Aggregator
GoodBot
—
›
PA
ParticleNewsBot
Unknown operator
Aggregator
GoodBot
—
›
PI
PinterestBot
Pinterest
Aggregator
GoodBot
—
›
PL
Placer.ai-Crawler
Unknown operator
Aggregator
GoodBot
—
›
PR
Pricey
Wilico
Aggregator
GoodBot
—
›
QU
Quartr Crawler
Quartr
Aggregator
GoodBot
—
›
RA
Rakuten Image extraction bot
Rakuten
Aggregator
GoodBot
—
›
SE
ServerHunterSpider
Server Hunter
Aggregator
GoodBot
—
›
SK
Skroutz ImageBot
Skroutz S.A.
Aggregator
GoodBot
—
›
ST
Statabot
StataCorp LLC
Aggregator
GoodBot
—
›
ST
StatistikAustria
Statistik Bot
Aggregator
GoodBot
—
›
ST
StatsDroneBot
StatsDrone
Aggregator
GoodBot
—
›
WE
WebSpiderMount
Aspen Tech Labs
Aggregator
GoodBot
—
›
EM
eMoney Advisor
eMoney Advisor
Aggregator
GoodBot
—
›
UP
upday
upday GmbH & Co. KG
Aggregator
GoodBot
—
›
VI
videootv Bot
Videoo.tv
Aggregator
GoodBot
—
›
Other categories
Browse the rest of the bot taxonomy.