What Is llms.txt? How to Create It and Does It Actually Work in 2026?

Over the past two years, one file name keeps coming up wherever GEO (Generative Engine Optimization) is discussed: llms.txt. Some call it "robots.txt for AI"; others present it as the key to appearing in ChatGPT.

This guide covers what llms.txt is, how to create it and — most importantly — what it actually does. We rely not on marketing claims but on Google's official statements and independent research covering hundreds of thousands of sites.

Short answer: llms.txt is an easy, low-cost file to create. But as of October 2026, available data does not show a measurable effect on visibility in ChatGPT, Google AI Overviews or other AI search. Its real value is giving AI agents a clean content map on software and documentation sites.

What Is llms.txt?

llms.txt is a file format proposed in September 2024 by Jeremy Howard, co-founder of Answer.AI. The proposal is published at llmstxt.org.

The idea is simple: you place a Markdown file at your site root (yoursite.com/llms.txt) that briefly tells large language models (LLMs) what your site is about and lists your most important pages with short descriptions.

The motivation: web pages are full of menus, ads, cookie banners and JavaScript. Extracting the real content from that clutter is hard for an AI system. llms.txt provides a clean, structured map instead.

Is llms.txt an official standard?

No. llms.txt is a proposal, not a protocol approved by a standards body. Unlike robots.txt, there is no official commitment from major search engines or AI companies to read it.

llms.txt vs robots.txt vs sitemap.xml

These three files are often confused but do entirely different jobs:

A key distinction: llms.txt does not control access. Whether AI bots can enter your site is decided by robots.txt (and your server/CDN settings). You can't invite a bot blocked in robots.txt back in via llms.txt.

llms-full.txt and Markdown versions

The proposal includes two complementary ideas. llms-full.txt collects all important content into one long Markdown file. It also suggests serving clean Markdown versions of pages by appending ".md" to URLs — this site serves its blog posts that way.

Does It Actually Work? What the Data Says

This is the most important question about llms.txt, and the answer should come from data, not claims.

Google's position

• July 2025: Google's Gary Illyes said at Search Central Live that Google doesn't support llms.txt and has no plans to. John Mueller compared it to the keywords meta tag, which search engines stopped using years ago.
• May 15, 2026: Google published its first official optimization guide for AI features on Search Central. It states plainly that you don't need to create new machine-readable files, AI text files or Markdown versions to appear in AI Overviews and AI Mode. Fundamental SEO best practices apply.

An interesting detail: Google's Lighthouse team started checking for llms.txt by default in version 13.3, so different Google teams send different signals. For Search and its AI features, Search Central's statement is what counts.

Independent research

One detail from SE Ranking's study stands out: among the 50 domains most cited in AI answers, only one had an llms.txt file.

OpenAI and others

OpenAI's crawler documentation directs site owners to robots.txt for managing AI access and does not mention llms.txt. The search bots of ChatGPT, Perplexity and Claude read pages' HTML; available logs do not show them regularly fetching llms.txt.

Bottom line: as of 2026, llms.txt is not a ranking or visibility factor. Be cautious of anyone selling llms.txt as a service that will "make you visible in ChatGPT".

So Who Is llms.txt Useful For?

The data above doesn't mean llms.txt is useless. It just isn't useful where most people assume.

1. Software and documentation sites

Coding assistants and AI agents in developer tools routinely use llms.txt when looking up a library's or API's documentation. If you publish APIs, SDKs or technical docs, llms.txt (and especially llms-full.txt) can genuinely help.

2. Preparing for AI agents

AI agents that browse, fill in forms or make bookings on users' behalf are spreading. llms.txt can offer them a clean entry point. Its impact today is limited, but the cost is so low that it can be added as forward-looking preparation.

3. Summarizing your own content

A well-written llms.txt forces you to state clearly what your site stands for. That exercise alone helps sharpen your overall message.

Who shouldn't prioritize it?

For local businesses, small corporate sites and e-commerce sites, llms.txt is not a priority. They will get far more from spending that time on the fundamentals below.

How to Create an llms.txt File

If you decide to create one, a proposal-compliant file is easy to prepare.

File structure

Per the proposal, the file has these sections, in this order:

• H1 title (required): the site or project name.
• Blockquote: a one- or two-sentence summary of what the site is about.
• Descriptive paragraphs (optional): extra context on how to use the site.
• H2 sections: each containing items made of a link and a short description.
• "Optional" section: secondary resources that can be skipped.

Example llms.txt

A simple example for a consulting site:

# Example Consulting

> Example Consulting is an Istanbul-based SEO and GEO consultancy offering technical SEO, content strategy and AI search visibility services.

## Services
- [SEO Consulting](https://example.com/seo): Technical SEO, content and authority work
- [GEO Consulting](https://example.com/geo): Visibility in AI answers

## Guides
- [Technical SEO Guide](https://example.com/guides/technical-seo.md): Crawling, indexing and site architecture

## Optional
- [About](https://example.com/about): Team and background

You can also view this site's own file at fatihemincakiroglu.com/llms.txt.

Step-by-step setup

• Pick your 10–30 most important pages (don't add everything)
• Write a neutral one-sentence description for each
• Build the file in Markdown using the structure above
• Upload it to the root: yoursite.com/llms.txt
• Open it in a browser to confirm it displays as plain text
• Verify all links work and point to canonical URLs
• Add updating the file to your workflow as key pages are added

Checking llms.txt Requests in Server Logs

If you want to know whether your file is actually read, your server logs are the most reliable source. On a Linux server you can run a simple search over access logs:

grep "GET /llms.txt" access.log | awk -F'"' '{print $6}' | sort | uniq -c | sort -rn

This lists the user agents requesting llms.txt by count. On platforms like Vercel or Netlify, get the same data from the platform's log or analytics panel.

In the same logs, check how often bots like OAI-SearchBot, ChatGPT-User, PerplexityBot and Claude-SearchBot visit your normal pages. You'll likely find they read your HTML pages far more often than llms.txt.

Common Mistakes

• Treating llms.txt as a ranking factor: the most common and most expensive mistake. Adding the file and waiting for visibility gains delays the real work.
• Contradicting robots.txt: listing key pages in llms.txt while blocking AI bots in robots.txt or the CDN. The file then does nothing.
• Missing the CDN's default bot block: since mid-2025 Cloudflare blocks AI crawlers by default on new sites. However good your llms.txt, a bot that can't enter reads nothing.
• Listing everything: llms.txt is not a sitemap; its purpose is to be selective.
• Making claims not on the page: descriptions in llms.txt that don't match or exaggerate your content. AI systems read your actual content.
• Not maintaining it: a file with broken links or removed pages does more harm than good.

The Real Priorities for AI Visibility

If your goal is to appear in ChatGPT, Gemini, Perplexity or Google AI Overviews, spend time on these steps before llms.txt:

• 1. Access: allow search bots like OAI-SearchBot, PerplexityBot and Claude-SearchBot in robots.txt. Check CDN and firewall settings.
• 2. Readable HTML: make sure your main content is in the page HTML.
• 3. Content that answers questions directly: give clear answers to the questions your customers ask.
• 4. Brand consistency: align information across your site, Google Business Profile, social profiles and directories.
• 5. Third-party sources: appear in industry publications, comparisons and trusted lists.
• 6. Measurement: regularly test how your brand appears in AI answers.

For the last point, use our guide to testing how your brand appears in ChatGPT. For the overall GEO framework see our GEO guide, and for professional support our GEO consulting page.

Frequently Asked Questions

Does llms.txt affect SEO?

No. Google has officially stated that it doesn't use llms.txt and that it isn't needed for AI Overviews or AI Mode. The file has no effect on Google rankings.

Will llms.txt make me visible in ChatGPT?

Current data doesn't show that. ChatGPT's search bot reads your pages' HTML. Allowing OAI-SearchBot in robots.txt and offering quality content matter far more.

Is there any harm in adding llms.txt?

If prepared correctly, no direct harm. The real risk is assuming nothing else needs to be done for AI visibility once it's added.

Are llms.txt and robots.txt the same?

No. robots.txt defines which pages bots may access, and major bots comply. llms.txt only offers a summary map of content and restricts no bot.

Who should definitely use llms.txt?

Software companies publishing APIs, SDKs or technical documentation — coding assistants genuinely use these files. For other sites it is an optional, low-priority step.

Could the status of llms.txt change?

Yes. AI companies may officially support it in the future, and we will update this article as things develop. For now, we recommend basing decisions on data, not claims.

8+ years of hands-on SEO and GEO experience across 150+ projects in e-commerce, SaaS, healthcare and local business sectors. Writes based on real client data, not theory.