apache / apache/texera

Add llms.txt to texera.apache.org

Open
#4,932 2 comments 0 reactions 1 assignee Claimed by @Ma77Ball View on GitHub
Dominant language
Scala
Stars
314
Forks
187
Avg merge
1d 21h
Merged PRs (30d)
214

Description

### Feature Summary

[llms.txt](https://llmstxt.org/) is an emerging convention for exposing a site's documentation in a machine-readable index that LLM agents can consume — conceptually similar to a sitemap for crawlers, but aimed at agents.

Texera's documentation is hosted on texera.apache.org. Without an `llms.txt`, agents have to scan source code or the rendered site to answer questions about Texera. Publishing an `llms.txt` would give them a structured directory of the site's content, enabling things like:

- Answering "does Texera support X?" by reading the docs index instead of scanning source code.
- Serving as the foundation for a Texera agent knowledge base (similar to what Spark has done).
- A low-cost, structured entry point that we can grow as more content lands on apache.org.

Example from ng-zorro: https://ng.ant.design/llms.txt

### Proposed Solution or Design

1. Add `llms.txt` to [apache/incubator-texera-site](https://github.com/apache/incubator-texera-site) so it is served at `texera.apache.org/llms.txt`.
2. Add an `AGENTS.md` to that repo noting that `llms.txt` should be kept in sync when site content changes (updates are expected to be infrequent).
3. Gradually expand coverage as more content moves onto apache.org.

References:
- llms.txt spec: https://llmstxt.org/
- Example: https://ng.ant.design/llms.txt
- Site repo: https://github.com/apache/incubator-texera-site

### Impact / Priority

(P3) Low – nice to have, low maintenance cost.

### Affected Area

Other (apache/incubator-texera-site)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.