GuidesAI search

llms.txt: what this file for AI is for

By the Banzai Labs teamUpdated on 2 min read

The site, for humans/llms.txt# Banzai Labs> ...-----A Markdown map, for AI
The site for humans, and the llms.txt file: a Markdown map for models.

The format

A Markdown text file at /llms.txt. A title, a one-sentence summary, then lists of annotated links.

# Site name

> One sentence saying what the site does and for whom.

## Guides
- [Guide title](https://example.com/guide): what you learn there.

## Product
- [Pricing](https://example.com/pricing): plans and their limits.

What it brings, and what it does not

Staying clear-eyed
What it does
  • A clean summary, without menus or scripts
  • The key pages at a glance
  • Useful to agents reading docs
What it does not
  • Guarantee a citation
  • Replace good content
  • Replace the sitemap

Writing it well

  • A summary sentence that could be quoted as is.
  • Ten to thirty links, not the whole site.
  • Update it with the sitemap, at build time.

The rest of the work matters more: how AI picks its sources and robots.txt and sitemap.

Frequently asked questions

Do Google or ChatGPT read llms.txt?
To date, no major engine has publicly confirmed using it to rank or cite. It mostly serves tools and agents that look for it, for example to read documentation.
Does it replace the sitemap or robots.txt?
No. robots.txt says what crawlers may read, the sitemap lists every page, llms.txt sums up the most useful ones.
Is it worth it?
It takes ten minutes and harms nothing. For a documentation site or a technical product, it helps developers who use assistants.

Read next

All guides