Skip to content
GP

GPTBot/1.4

UndecidedCommunity-sourced

GPTBot/1.4 is a web-crawling tool developed by OpenAI designed to enhance the performance of its language models by collecting information from the internet. Its primary function is to gather data from various online sources, allowing the models to improve their understanding and generate more accurate responses. Key features of GPTBot/1.4 include the ability to access a wide range of website content, gather diverse datasets, and use this information to refine and update the knowledge base of OpenAI's models. The bot operates in accordance with web standards and respects the guidelines set in the robots.txt file of websites, which dictates permissible crawling activities. By utilizing GPTBot/1.4, OpenAI aims to continuously enhance the capabilities of its language models while maintaining a commitment to ethical standards and user privacy. The bot's design reflects OpenAI's overarching goal of advancing AI technology responsibly. For the most current information and specific functionalities, you may refer to the official OpenAI website.

Undecided
Assessment
Uncategorized
Category
Bot
Kind
1
Data sources

Identification

Bot name
GPTBot/1.4
Category
Uncategorized
Verification
Community-sourced
User-agent string
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.4; +https://openai.com/gptbot)

IP ranges

Requests from GPTBot/1.4 originate from these published ranges. For strict verification, match the source IP against this list in addition to checking the user-agent and reverse-DNS.

Showing 24 of 62 ranges

Block or allow GPTBot/1.4

Block it

Add a Disallow rule for Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.4; +https://openai.com/gptbot) in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block GPTBot/1.4 from crawling your entire site
User-agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.4; +https://openai.com/gptbot)
Disallow: /

# Allow GPTBot/1.4 full access
User-agent: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.4; +https://openai.com/gptbot)
Allow: /
Allow & verify

Ensure your robots.txt allows Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.4; +https://openai.com/gptbot). Verify requests by checking the user-agent string.

Traffic & trends

Cloudflare Radar traffic

No Cloudflare traffic data available.

Google Trends interest

Loading trend data…

Data sources

This profile is compiled from the following sources.

CrawlersDatabase
Last updated September 8, 2026

Something wrong with this entry? Suggest a correction