llms.txt

llms.txt is a convention (proposed at llmstxt.org) where a site publishes a plain-markdown file at /llms.txt that lists its most important pages with short descriptions, plus optionally a /llms-full.txt containing the full content corpus. It gives LLM-based crawlers and agents a token-efficient, noise-free way to understand a site instead of parsing navigation-heavy HTML.

Adopting llms.txt costs little and signals AI-friendliness: pair it with markdown versions of key pages and correct robots.txt rules for AI crawlers (GPTBot, ClaudeBot, Google-Extended and friends) so engines can actually read what you want them to cite.