guide llms.txt improvements
Open
@thibaudcolas is already working on this.
Since Jan 27, 2026.
django
documentation
- Dominant language
- Python
- Stars
- 36
- Forks
- 39
- Avg merge
- 2d 5h
- Merged PRs (30d)
- 3
Description
Follow-up improvements to #412 / #413, based on further testing of the files and feedback (thread: llms.txt feedback #13648).
- Track files’ token lengths
- Make the files discoverable directly from the site: #416
- remove "About" and "Contributing" pages to increase signal to noiset
- set a target of token count so the file fits in small models’ context windows (for example to fit in a 32k context)
Postponed
Potential improvements where I’m not sure how high the ROI is:
- TBC: docs-focused MCP server
- add inline heading links to Markdown to encourage direct linking to relevant sections
- change the "full" format so there is less ambiguity about documents’ start and end
- Extract as a package
- Set up CDN-level caching of
text/plainandtext/markdownresponses - Remove "releases" pages from the files (they shouldn’t be relevant to answer questions about the CMS)
- #415
- Unit tests for lack of HTML escaping
- Trial LLM-focused information
- Information only present in llms.txt
- Information only present in pages’ markdown representations
- Information only present in llms-full.txt
- Page only linked from llms.txt
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.