ContactBook a call

AI search

llms.txt

llms.txt is a proposed standard, published by Jeremy Howard in September 2024, for a Markdown file at the root of a website that gives language models a short summary of the site and links to its most useful pages.

How it works in practice

Web pages are written for people and carry navigation, scripts and layout that make them harder for a model to read. An llms.txt file gives a model a plain map: what the site is, then a list of key pages with a one-line description of each. Some sites also publish llms-full.txt with full page text, and Markdown versions of individual pages.

It is cheap to publish and does no harm, but major AI providers have not confirmed that they use it for search or answers, so it should sit alongside good pages and structured data, never replace them. Developer documentation sites have taken it up most, because coding assistants read them.

A worked example

A software company publishes llms.txt listing its pricing page, API reference and setup guides, each with a Markdown version. A developer pointing an AI coding assistant at the site gets clean, current text instead of rendered HTML.

Examples in this glossary describe typical builds for companies of 1 to 1,000 people. They are not named client results.

See which of these apply to your team

On a discovery call we map the manual work in your team and show you which of these would change it first.

Book a discovery call

Cookie preferences

Choose what this site may use on your device. You can change this at any time from “Cookie settings” in the footer.

Strictly necessary

Keep the site working and remember the choices you make here. These cannot be switched off, and none of them track you.

Always on
What this includes (4)
NameProvider PurposeDuration
sbd-consentThis site Remembers your cookie choices12 months
Vercel Web AnalyticsVercel Inc. Counts page views in aggregate. Sets no cookie and stores nothing on your deviceNone
ticker-dismissed, sbd-note-offThis site Remembers that you closed a notice or language tipUntil the tab closes
sbd-voice-resume, sbd-voice-prefillThis site Carries a voice conversation across pages, only if you start oneUntil the tab closes

Analytics

Tell us which pages are read and where visitors leave, so we can improve them. IP addresses are anonymised and nothing is used for advertising.

What this includes (2)
NameProvider PurposeDuration
_gaGoogle Analytics (Google LLC) Distinguishes visitors with a random ID13 months
_ga_FPXDMQPRV1Google Analytics (Google LLC) Keeps the session state for this site13 months

Functional

Embedded services that set their own cookies. Without them the site still works; you get a link to open the service instead.

What this includes (1)
NameProvider PurposeDuration
Booking calendarCal.com Inc. Shows live availability and books the call on the booking pageSet by Cal.com

Advertising

Not used. This site has no advertising, retargeting or social media tracking, and we never sell data.

Not used

Questions about your data: hello@smallbaydigital.com