Skip to main content

Adding llms.txt and ai.txt to your site

A practical guide to publishing llms.txt, ai.txt and an AI-friendly robots.txt so models read and represent your brand correctly.

llms.txt and ai.txt are small plain-text files at the root of your domain that tell AI systems what your brand is and which content to trust. They’re among the cheapest, highest-leverage things you can add for AI visibility.

llms.txt

Place it at https://yourdomain.com/llms.txt. Use Markdown: open with a title and a one-line summary of what you do, then an About section, a list of your products, and links to your most important pages (docs, pricing, customers). Keep it factual and specific so a model can quote it directly.

ai.txt

ai.txt states your AI-usage policy and a few brand facts: name, category, canonical URL, and which pages you’d prefer models to summarize.

Don’t forget robots.txt

Allow the AI crawlers you want (GPTBot, ClaudeBot, Google-Extended, PerplexityBot, …) and point them to your sitemap. Blocking them by accident is a common reason brands are invisible to AI search.

Tip: LumaRank's own site publishes a real /llms.txt and /ai.txt (we dogfood every signal we recommend).

Where to put them

Both files live at the root of your domain (/llms.txt and /ai.txt), served as plain text. If your stack can't drop static files at the root, generate them from a route so the URLs always point at your real pages. Keep them in sync with a single source of truth (your brand name, description and key links) so they never drift from the rest of your site.

Common mistakes

  • Blocking AI crawlers in robots.txt by accident (check your disallow rules).
  • Listing pages in llms.txt that redirect, 404 or sit behind a login.
  • Writing marketing fluff instead of clear, factual descriptions a model can quote.
  • Forgetting to update the files when your product or positioning changes.

Once these are live, re-run your audit and watch the AI signals turn green. Read how scoring works for the full list.