llms.txt

llms.txt is a proposed standard for a Markdown file, usually placed at a site's root, that gives large language models a concise guide to the site's most useful content.

Example

A software company publishes a file at /llms.txt with its name as a heading, a one-paragraph summary of what it does, and short lists of links to its documentation, pricing page and key guides.

How it works

The llms.txt proposal suggests a Markdown file at the site root, or at a path within it covering the pages under that path. Unlike robots.txt, which tells crawlers what they may access, llms.txt is meant to point models to the content worth reading.

Why it matters

llms.txt is a proposal, not a protocol every AI system has said it reads, and support varies. It is usually cheap to add and maintain, but it is unlikely to replace the basics: clear content, accurate facts and pages that AI crawlers can reach.

Related terms

• AI crawler
• LLMO
• Generative engine optimization (GEO)
• Answer engine optimization (AEO)
• Is llms.txt worth it?