AC
Academic Research
9 botsCrawlers run by universities and research groups to study the web.
About Academic Research bots
Academic-research crawlers collect pages for scholarly study of the web - measurement, archival, or corpus building. They generally identify their institution and honor robots.txt, though crawl behaviour varies by project.
Academic Research
Bots in this category
Every crawler and agent we classify as Academic Research. Click through for identification, IP ranges, and block rules.
Bot · OperatorCategorySentimentTraffic · 14d
BI
Bibliotheque Nacional de France Crawler
Bibliothèque nationale de France
Academic Research
GoodBot
—
›
CM
CMU-Cylab
Carnegie Mellon University
Academic Research
GoodBot
—
›
LI
Library Of Congress Web Archiving
United States Library of Congress
Academic Research
GoodBot
—
›
OM
OMIM Litrack
Unknown operator
Academic Research
GoodBot
—
›
SC
ScientificAdvisorBot
Scientific Advisor
Academic Research
GoodBot
—
›
TN
TNOThesisCrawler
Unknown operator
Academic Research
GoodBot
—
›
TR
TrustedSite
Unknown operator
Academic Research
GoodBot
—
›
TU
TurnitinBot
Turnitin
Academic Research
GoodBot
—
›
KB
kb.dk_bot
Netarkivet
Academic Research
GoodBot
—
›
Other categories
Browse the rest of the bot taxonomy.