OAI-SearchBot/1.3

UndecidedCommunity-sourced

OAI-SearchBot/1.3 is a web crawler developed by OpenAI that is designed to index and search for information across the internet. This tool is part of OpenAI's efforts to improve the accessibility of information and provide efficient search capabilities. SearchBot works by systematically browsing web pages, collecting data, and organizing it to facilitate quick retrieval in response to user queries. The bot utilizes advanced algorithms to ensure that the information it gathers is relevant and up-to-date. Its design emphasizes performance and accuracy while adhering to ethical guidelines for web crawling. Overall, OAI-SearchBot/1.3 plays a crucial role in enhancing search functionalities for various applications by refining how users interact with and access information online. For the most accurate and specific details, you may want to refer directly to the OpenAI website source you mentioned.

Operator website ↗

Undecided

Assessment

Uncategorized

Identification

Bot name

OAI-SearchBot/1.3

IP ranges

Requests from OAI-SearchBot/1.3 originate from these published ranges. For strict verification, match the source IP against this list in addition to checking the user-agent and reverse-DNS.

Showing 24 of 241 ranges

Block or allow OAI-SearchBot/1.3

Block it

Add a Disallow rule for Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.3; +https://openai.com/searchbot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.

# Block OAI-SearchBot/1.3 from crawling your entire site
User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.3; +https://openai.com/searchbot
Disallow: /

# Allow OAI-SearchBot/1.3 full access
User-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.3; +https://openai.com/searchbot
Allow: /

Allow & verify

Ensure your robots.txt allows Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/131.0.0.0 Safari/537.36; compatible; OAI-SearchBot/1.3; +https://openai.com/searchbot. Verify requests by checking the user-agent string.