GrowliBot

GrowliBot is the crawler behind Growli. It visits a website only when someone asks us to audit that site, and reads it the way a search engine does.

How it identifies itself

GrowliBot/1.0 (+https://growli.si/bot; site audit on request of the site owner)

What it does

It reads your robots.txt, sitemap, llms.txt and a limited number of public pages, at most 3 requests at a time. It never logs in, never submits forms and never reads anything that is not public.

To check whether AI assistants can reach your site, it also requests your homepage once with the public user agents of GPTBot, OAI-SearchBot, ClaudeBot and PerplexityBot, and compares the answers. The audit report tells the site owner if their firewall turns those assistants away.

How to block it

GrowliBot follows robots.txt. To keep it out of your whole site, add:

User-agent: GrowliBot
Disallow: /

Questions

If GrowliBot causes a problem on your site, contact us through the details in our Privacy Policy and we will look into it right away.