OAI-SearchBot/1.4
UndecidedCommunity-sourcedOAI-SearchBot/1.4 is a web crawler designed to enhance the discovery and indexing of information across various online platforms. This bot efficiently scans and retrieves content from websites, enabling more comprehensive search results for users. By utilizing advanced algorithms, it ensures that the indexed information is relevant and up-to-date, facilitating improved search experiences. The bot respects website protocols and adheres to guidelines set by webmasters, promoting ethical web crawling practices. For more detailed insights, you may refer to the official OpenAI source on SearchBot.
Identification
IP ranges
Requests from OAI-SearchBot/1.4 originate from these published ranges. For strict verification, match the source IP against this list in addition to checking the user-agent and reverse-DNS.
Block or allow OAI-SearchBot/1.4
Add a Disallow rule for Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; +https://openai.com/searchbot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block OAI-SearchBot/1.4 from crawling your entire site User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; +https://openai.com/searchbot Disallow: / # Allow OAI-SearchBot/1.4 full access User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; +https://openai.com/searchbot Allow: /
Ensure your robots.txt allows Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.4; +https://openai.com/searchbot. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction