MainWP
GoodBotVerifiedBOTWebsite Managed - MainWP Control Dashboard for accessing MainWP child sites. Operated by Direct Support / Website Managed.
What is MainWP?
MainWP is a web crawler operated by Direct Support / Website Managed. Website Managed - MainWP Control Dashboard for accessing MainWP child sites.
Identification
MainWP/How we rated this bot
Verified by Cloudflare, which confirms who runs it, with no widespread reports of abuse.
What we read
- 14 Common WordPress Robots.txt Mistakes to Avoid - WP Rocket
- Wordpress Robots.txt Best Practices - How to Optimize WordPress Robots.txt [Still true in 2023!]
- The WordPress robots.txt File... What it is and What it Does - Pressidium® Managed WordPress Hosting
- Robots.txt For WordPress Sites | Pressable
- How to Configure Robots.txt and WordPress | WP Engine Support
Why it crawls your site
MainWP crawls websites to deliver webhook payloads and verify endpoints. It is operated by Direct Support / Website Managed as part of their webhook delivery infrastructure. If you see this bot in your server logs, it is a verified crawler and generally safe.
Block or allow MainWP
Add a Disallow rule for MainWP/ in your robots.txt file. You can also block at the server level using your web server configuration or CDN firewall rules to filter requests matching the user-agent string.
# Block MainWP from crawling your entire site User-agent: MainWP/ Disallow: / # Allow MainWP full access User-agent: MainWP/ Allow: /
Ensure your robots.txt allows MainWP/. Verify requests are genuine by checking the user-agent string and referring to Direct Support / Website Managed's documentation.
Traffic & trends
No Cloudflare traffic data available.
Loading trend data…
From the community
Recent Reddit discussion mentioning this bot.
Links & references
Data sources
This profile is compiled from the following sources.
Something wrong with this entry? Suggest a correction