LLMs.txt Generator
Crawl your site and build a spec-compliant llms.txt for AI.
Make your website AI-ready: enter one URL and we crawl your public pages, read each one's title and meta-description, and build a clean, spec-compliant llms.txt — an H1 site name, a summary blockquote and grouped link lists — that helps ChatGPT, Claude, Perplexity and Gemini understand and cite your content. Edit the name, summary and page selection, then copy or download. Free and unlimited.
How to use LLMs.txt Generator
Enter your website
Type your homepage URL into the free online llms.txt generator — it normalizes the address and prepares to crawl your public pages automatically.
Set crawl options
Choose to respect robots.txt, skip admin or restricted paths, and cap the max pages so the generator focuses on your most important public content.
Generate llms.txt
Click Generate and watch the live crawl read each page's title and meta description, instantly building a spec-compliant llms.txt as it scans your site.
Edit the details
Tweak the H1 site name and summary blockquote, toggle page descriptions, and group pages into ## sections by URL path for a clean, curated file.
Pick your pages
Untick any pages you don't want AI models like ChatGPT, Claude, Perplexity or Gemini to focus on, refining the link list to your key URLs.
Copy or download
Copy the finished llms.txt or download it, then upload the file to your site root at example.com/llms.txt so AI assistants can read it.
Frequently asked questions
What is llms.txt and why does my website need one?
llms.txt is an emerging standard (llmstxt.org) — a Markdown file at your site root that gives AI models a clean, curated map of your most important pages. Adding an llms.txt helps assistants like ChatGPT, Claude, Perplexity and Gemini understand your content and cite it accurately.
How do I generate an llms.txt file for my site?
Enter your website URL and this free llms.txt generator crawls your public pages, reads each page's title and meta description, and builds a spec-compliant llms.txt automatically. You can then edit the site name and summary, untick pages, and copy or download the finished file.
What is the difference between llms.txt and robots.txt?
robots.txt controls which paths crawlers may request, while llms.txt helps AI models understand and cite your content by giving them a curated list of your key pages. They serve different purposes, so most sites benefit from having both.
Where do I put the llms.txt file once it is generated?
Upload it to your site root so it is reachable at https://example.com/llms.txt. For single-page apps put a real llms.txt in your public folder (or serve it from a route) so it returns as plain text rather than your app's HTML shell.
Is this llms.txt generator free and is my site data stored?
Yes, the llms.txt generator is free and unlimited. The crawl runs on our server to read titles and descriptions, but the page content is used only for the moment it is read and not stored; the grouping, Markdown build, copy and download all happen in your browser.
Does the generator respect robots.txt and skip private pages?
Yes. By default it respects your robots.txt and skips admin, login and checkout areas, and you can toggle both options. You can also cap the number of pages crawled so the generated llms.txt focuses on your most important public content.
What format does the generated llms.txt use?
It follows the llmstxt.org spec: an H1 site name, a summary blockquote, and grouped ## sections of - [Title](url): description link lists organised by URL path. You can choose to include page descriptions and to group pages into sections.
Related tools — AI · LLMs.txt tools
- LLMs.txt Validator — Check an llms.txt against the llmstxt.org spec.
- LLMs.txt Checker — Does a domain have an llms.txt? Detect, preview & flag issues.