About our crawler bot
WaNexusBot is the web crawler we use to fetch pages that a customer has added as a knowledge source for their AI agent.
What it does
When a customer adds a website URL to an AI agent, the bot fetches that page and linked pages on the same domain so the agent can answer questions from them. It does not index pages for search.
User agent
The bot identifies itself with a user agent containing “WaNexusBot”.
Respecting your site
- The bot honours robots.txt disallow rules.
- It crawls at a low rate and only on customer request.
- It does not submit forms or log in.
Block or contact us
To block it, add a Disallow rule for “WaNexusBot” in robots.txt. For questions, email support@mirachdigital.com.