AC
Academic Research
113 botsCrawlers run by universities and research groups to study the web.
About Academic Research bots
Academic-research crawlers collect pages for scholarly study of the web - measurement, archival, or corpus building. They generally identify their institution and honor robots.txt, though crawl behaviour varies by project.
Academic Research
Bots in this category
Every crawler and agent we classify as Academic Research. Click through for identification, IP ranges, and block rules.
Bot · OperatorCategorySentimentTraffic · 14d
AB
AbarroteBot
Unknown operator
Academic Research
GoodBot
—
›
AB
AboveSpot
Talaro Pty Ltd
Academic Research
GoodBot
—
›
AG
AgenstryBot
Unknown operator
Academic Research
GoodBot
—
›
AL
AlgoProBot
Unknown operator
Academic Research
GoodBot
—
›
AP
AppWatchBot
Unknown operator
Academic Research
GoodBot
—
›
AR
Argios Monitoring Bot
Unknown operator
Academic Research
GoodBot
—
›
AX
AxionReader
Axion Labs
Academic Research
GoodBot
—
›
BE
BeanwiredBot
Beanwired
Academic Research
GoodBot
—
›
BE
BellezaCheckBot
BellezaCheck
Academic Research
GoodBot
—
›
BE
BenchologyCompetitorBot
Unknown operator
Academic Research
GoodBot
—
›
BE
BenzieLiveBot
benzie.live
Academic Research
GoodBot
—
›
Bibliotheque Nacional de France Crawler
Bibliothèque nationale de France
Academic Research
GoodBot
—
›
BI
BidsterBot
Bidster
Academic Research
GoodBot
—
›
BI
BigBookPrices Bot
Unknown operator
Academic Research
GoodBot
—
›
BI
BixelBot
Bixel
Academic Research
GoodBot
—
›
CL
CLB Insight
COLAB
Academic Research
GoodBot
—
›
CMU-Cylab
Carnegie Mellon University
Academic Research
GoodBot
—
›
CI
CirclinInventoryBot
Unknown operator
Academic Research
GoodBot
—
›
CO
ConquestBot
Conquest Cars Canada Inc.
Academic Research
GoodBot
—
›
CO
CoolNCampBot
Unknown operator
Academic Research
GoodBot
—
›
CO
CoralBay Intelligence
Unknown operator
Academic Research
GoodBot
—
›
CR
CredScapeBot
CredScape Market Intelligence Inc.
Academic Research
GoodBot
—
›
DM
DMCA Force
Unknown operator
Academic Research
GoodBot
—
›
DA
DataEdge
Nexa Equity
Academic Research
GoodBot
—
›
DA
Dayposter
Dayposter
Academic Research
GoodBot
—
›
DE
DealerDataOne-Crawler
Unknown operator
Academic Research
GoodBot
—
›
DE
DeepSahelBot
Introgy AI
Academic Research
GoodBot
—
›
DE
Dekordia Automation Bot
Unknown operator
Academic Research
GoodBot
—
›
DI
DinteligentBot
Unknown operator
Academic Research
GoodBot
—
›
DI
DiscophileBot
Unknown operator
Academic Research
GoodBot
—
›
EA
EarningsTrackerBot
Unknown operator
Academic Research
GoodBot
—
›
EN
EnfiladeBot
Unknown operator
Academic Research
GoodBot
—
›
EV
EveryWeekBot
EveryWeek
Academic Research
GoodBot
—
›
FA
FarmetricaBot
Unknown operator
Academic Research
GoodBot
—
›
FI
Filmarks-EC-Importer
Unknown operator
Academic Research
GoodBot
—
›
FI
FindMeStockBot
Unknown operator
Academic Research
GoodBot
—
›
FO
FossickBot
Unknown operator
Academic Research
GoodBot
—
›
FO
FourishBot
HakuSoft
Academic Research
GoodBot
—
›
GB
GBTradarBot
Unknown operator
Academic Research
GoodBot
—
›
GO
GoDoBot
Go Do - Live Life, LLC
Academic Research
GoodBot
—
›
GU
GunplaDealsBot
Unknown operator
Academic Research
GoodBot
—
›
GU
GuthBot
Unknown operator
Academic Research
GoodBot
—
›
HE
HemerolabBot
Hemerolab
Academic Research
GoodBot
—
›
HU
HumanSourcer-Scraper
Unknown operator
Academic Research
GoodBot
—
›
IN
InviniteDataBot
Unknown operator
Academic Research
GoodBot
—
›
IR
IronScout
IronScout
Academic Research
GoodBot
—
›
JE
JellyBot
Unknown operator
Academic Research
GoodBot
—
›
JO
Joshternet-Joshbot
Unknown operator
Academic Research
GoodBot
—
›
KA
KarsilastirmaBot
Unknown operator
Academic Research
GoodBot
—
›
KI
KiasuPriceBot
Unknown operator
Academic Research
GoodBot
—
›
KU
KulakBot
Unknown operator
Academic Research
GoodBot
—
›
KU
KulbyBot
Unknown operator
Academic Research
GoodBot
—
›
LO
LORE Tennis news bot
Unknown operator
Academic Research
GoodBot
—
›
LE
Legisail
Legisail
Academic Research
GoodBot
—
›
Library Of Congress Web Archiving
United States Library of Congress
Academic Research
GoodBot
—
›
LI
LivetrendBot
Unknown operator
Academic Research
GoodBot
—
›
LO
LockleyBot
Unknown operator
Academic Research
GoodBot
—
›
LO
LovedForeverBot
Unknown operator
Academic Research
GoodBot
—
›
MA
MacNTrackBot
Unknown operator
Academic Research
GoodBot
—
›
MA
MarketfaunaBot
Unknown operator
Academic Research
GoodBot
—
›
NW
Nwly Bot
Unknown operator
Academic Research
GoodBot
—
›
OMIM Litrack
Johns Hopkins University / NCBI
Academic Research
GoodBot
—
›
OD
OddlyBot
Unknown operator
Academic Research
GoodBot
—
›
OF
OfertonatorBot
Unknown operator
Academic Research
GoodBot
—
›
PT
PTODA-ResearchBot
Unknown operator
Academic Research
GoodBot
—
›
PA
PartnerAllyBot
Unknown operator
Academic Research
GoodBot
—
›
PE
Peated
Unknown operator
Academic Research
GoodBot
—
›
PeruzeBot
Peruze Technology Limited
Academic Research
GoodBot
—
›
PI
PickAudioRadar
Unknown operator
Academic Research
GoodBot
—
›
PL
PlaceDatumBot
Unknown operator
Academic Research
GoodBot
—
›
PR
PretAlertBot
Unknown operator
Academic Research
GoodBot
—
›
PR
Project Syndicate Crawler
Unknown operator
Academic Research
GoodBot
—
›
PU
PubAtlasBot
Unknown operator
Academic Research
GoodBot
—
›
RC
RCJAZ Inventory Synchronization Bot
Unknown operator
Academic Research
GoodBot
—
›
RA
RallyFoundEvents
Unknown operator
Academic Research
GoodBot
—
›
Raptive Megacrawler
Raptive
Academic Research
GoodBot
—
›
RA
RatingsReference
Unknown operator
Academic Research
GoodBot
—
›
RA
RaveetoBot
Unknown operator
Academic Research
GoodBot
—
›
RE
Renopal
Renopal
Academic Research
GoodBot
—
›
RE
RewearBot
Unknown operator
Academic Research
GoodBot
—
›
RI
RigSoukBot
SysPeek
Academic Research
GoodBot
—
›
SA
Salmonberry
Unknown operator
Academic Research
GoodBot
—
›
ScientificAdvisorBot
Scientific Advisor
Academic Research
GoodBot
—
›
SH
ShflBot
Caleb Wright
Academic Research
GoodBot
—
›
SP
SpiderLing
Unknown operator
Academic Research
GoodBot
—
›
SQ
SquishSignal
Unknown operator
Academic Research
GoodBot
—
›
ST
StackScopeBot
Unknown operator
Academic Research
GoodBot
—
›
ST
StreetFeedBot
Unknown operator
Academic Research
GoodBot
—
›
SY
SyntoraDataBot
Unknown operator
Academic Research
GoodBot
—
›
TC
TCGCompareBot
TCGCompare
Academic Research
GoodBot
—
›
TNOThesisCrawler
TNO (Netherlands Organization for Applied Scientific Research)
Academic Research
GoodBot
—
›
TA
TabTenderBot
Tab Tender
Academic Research
GoodBot
—
›
TE
TelintaleBot
Unknown operator
Academic Research
GoodBot
—
›
TE
TenderFans Event Harvester
Unknown operator
Academic Research
GoodBot
—
›
TrustedSite
TrustedSite
Academic Research
GoodBot
—
›
TurnitinBot
Turnitin
Academic Research
GoodBot
—
›
UL
Ultron Collector
Unknown operator
Academic Research
GoodBot
—
›
UN
Unclench.ai
Unknown operator
Academic Research
GoodBot
—
›
US
UserEconomicBot
Unknown operator
Academic Research
GoodBot
—
›
VP
VPSHostReviewBot
Unknown operator
Academic Research
GoodBot
—
›
VE
VeritasetBot
Veritaset
Academic Research
GoodBot
—
›
WB
WBDK-catalogue
Unknown operator
Academic Research
GoodBot
—
›
WA
WannadoBot
Wannado
Academic Research
GoodBot
—
›
WE
WebsiteTrackerBot
Unknown operator
Academic Research
GoodBot
—
›
WI
WindlassBot
Unknown operator
Academic Research
GoodBot
—
›
WO
Workana Site Review Crawler
Unknown operator
Academic Research
GoodBot
—
›
BA
barefoot-style-catalog
Unknown operator
Academic Research
GoodBot
—
›
ID
idea89-assistant
Unknown operator
Academic Research
GoodBot
—
›
kb.dk_bot
Netarkivet
Academic Research
GoodBot
—
›
OS
ostupilot
Unknown operator
Academic Research
GoodBot
—
›
TI
tidewatch
Unknown operator
Academic Research
GoodBot
—
›
TR
training.dental-bot
Unknown operator
Academic Research
GoodBot
—
›
TX
txtbot
Unknown operator
Academic Research
GoodBot
—
›
Other categories
Browse the rest of the bot taxonomy.