DowseBot
DowseBot is how DowseAI identifies itself when it reads a website. It only reads public pages, a few at a time, and it follows robots.txt.
When it visits
- When someone uses our free llms.txt checker on your site: robots.txt, /llms.txt and your home page, at most once every 10 minutes per site.
- When someone uses our free AI readiness checker on your site: robots.txt, your home page, /llms.txt and sometimes /sitemap.xml, at most once every 10 minutes per site.
- When someone uses our free AI crawler checker on your site: robots.txt only, at most once every 10 minutes per site.
- When the maker of a product orders an AI visibility report: that product's own home and pricing pages, and pages AI assistants cited in their answers.
How to stop it
Add this to your robots.txt and DowseBot won't read your pages:
User-agent: DowseBot Disallow: /
Questions or problems: hello@dowseai.com.