FeedmindBot is the crawler behind the Feedmind AI Readiness Check. When someone submits a shop URL, it reads a small sample of that store’s pages the way an AI assistant does — the plain, no-JavaScript HTML — to score how readable the catalog is to tools like ChatGPT, Perplexity and Gemini.
FeedmindBot runs on demand: a human ran an AI-readiness scan for your domain at getfeedmind.com. It is not a bulk web crawler and does not spider the whole internet — one scan reads your homepage plus a representative sample of product pages (about a dozen), then stops.
It fetches the plain, no-JavaScript HTML — exactly the surface an AI assistant sees. It never renders scripts, fills forms, signs in, or adds to cart.
Requests carry this User-Agent:
FeedmindBot/1.0 (+https://getfeedmind.com/bot)
A scan makes a handful of GET requests over a short window, paced to be polite (below), then goes quiet.
If you gate crawlers, allow the FeedmindBot token in robots.txt:
User-agent: FeedmindBot Allow: /
For firewalls that verify signed bots (Web Bot Auth), FeedmindBot signs its requests with HTTP Message Signatures (RFC 9421). When signing is enabled, the public key is published as a JWKS at https://getfeedmind.com/.well-known/http-message-signatures-directory.
To stop FeedmindBot crawling, disallow it in robots.txt — we honor it:
User-agent: FeedmindBot Disallow: /
To remove an already-published scorecard for your store, email [email protected]. We mark the store opted-out, which removes its scorecard from search indexing and from our sitemap.