ThinkGraphBot
ThinkGraphBot is the scanner behind ThinkGraph AI's free AI-visibility scan. It runs only when someone asks it to scan a site, never on a schedule, and it never crawls the web at large.
How to recognise it
Every request carries this user agent:
ThinkGraphBot/1.0 (+https://thinkgraphai.com/bot)
What it reads
- /robots.txt, first, before anything else.
- /llms.txt and your XML sitemap.
- Your homepage and up to 10 recent posts, found through the public WordPress REST API (/wp-json/wp/v2/posts) or your sitemap.
A scan makes about 20 requests, at most 4 at a time, and stops after 60 seconds. It reads public pages only. It does not log in, submit forms, run JavaScript or follow links off your domain, and it keeps no copy of your pages, only the findings (for example "no Article schema").
It obeys robots.txt
ThinkGraphBot follows the rules for the ThinkGraphBot user agent, or for * if you have not named it. To keep it out entirely:
User-agent: ThinkGraphBot Disallow: /
To let it in even though you block other crawlers:
User-agent: ThinkGraphBot Allow: /
If a firewall blocks it
Security services such as Cloudflare, Wordfence or Sucuri can show scanners a challenge page, and then we can't read the site. If you own the site and want it scanned, add an allow rule for requests whose user agent contains ThinkGraphBot. We don't publish a fixed IP range yet, so the user agent is the way to recognise us. Anyone can copy a user agent string, so use an allow rule that is scoped narrowly, or turn it on only while you scan.
