IsonSearchBot
GoodBotVerifiedBOTIsonSearchBot is the dedicated crawler for Ison Search, a search engine focused on indexing Indonesian-language web content. Operated by Epithre.
What is IsonSearchBot?
IsonSearchBot is the primary web crawler operated by Epithre to power Ison Search, a search engine specifically designed for the Indonesian internet ecosystem. Unlike many modern crawlers that harvest data for generative AI training, IsonSearchBot functions as a traditional indexer that directs traffic back to the original source. It operates with a focus on transparency, providing a verifiable list of its egress IP addresses and adhering strictly to standard web protocols like robots.txt.
Identification
How we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
- google ignoring robots.txt ? - Google Search Central Community
- I wonder if it will actually respect the robots.txt this time. | Hacker News
- AI Crawlers and robots.txt: Which Bots to Allow or Block - eSEOspace
- Meta Has New Web-Crawling Bots That Sneakily Get Around Robots.txt - Business Insider
- Does Google ignore robots.txt
Why it crawls your site
The bot crawls the web to build and maintain a searchable index of Indonesian-language content, ensuring that users can discover relevant local websites. It avoids executing JavaScript to minimize server load and maintains a polite crawl rate of one request every two seconds per host. Site owners can verify the bot's authenticity by cross-referencing the source IP against the JSON list published on the official Ison Search documentation page.
Block or allow IsonSearchBot
Add a Disallow rule for IsonSearchBot in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block IsonSearchBot from crawling your entire site User-agent: IsonSearchBot Disallow: / # Allow IsonSearchBot full access User-agent: IsonSearchBot Allow: /
Ensure your robots.txt allows IsonSearchBot. Verify requests by checking the user-agent string.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction