Learn
AI search, explained with evidence
How AI search tools find, read and use websites — based on official documentation and what Tooru measures.
All articles
- Technical guides
Does llms.txt work? Google’s position, and how Tooru scores it
Google says Search ignores llms.txt. It does no harm, but it is not where AI search work should start. Why Tooru gives llms.txt 4 points out of 100, and what to check first.
Updated 2026-10-09 - Technical guides
GPTBot vs OAI-SearchBot vs ChatGPT-User: which AI crawlers to allow
AI crawlers come in three groups: training, search and user-triggered. Don’t block search crawlers if you want to appear in AI answers. What OpenAI, Anthropic, Perplexity and Google each say, with a robots.txt example.
Updated 2026-10-09 - Technical guides
Can AI crawlers read JavaScript-rendered pages?
Assume most can’t. A 2024 measurement found none of the major AI crawlers rendered JavaScript; Google is the exception. How to check a page and how to fix it.
Updated 2026-10-09
Glossary
Short definitions of GEO, AEO, AI crawlers, llms.txt, MCP and other terms used in these articles.
Start with your home page.
Create a free account, enter your URL, and see where AI stops in about a minute.