AnswerDotAI / AnswerDotAI/llms-txt

Suggestion: /.well-known/llms.txt instead

Open
#2 18 comments 105 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
2.6k
Forks
163
Avg merge
1m
Merged PRs (30d)
1

Description

These days there's a increasingly adopted alternative to the `/robots.txt` and `/sitemap.xml` and `/favicon.ico` standards - the `/.well-known` prefix: https://en.wikipedia.org/wiki/Well-known_URI

These have been registered with IANA since ~2010: https://www.iana.org/assignments/well-known-uris/well-known-uris.xhtml

The RFC has the argument for why this is a good idea, which honestly I haven't read in a few years so I'm a bit rusty on: https://datatracker.ietf.org/doc/html/rfc5785

Oh, maybe this is it (quoting the RFC):

> When this happens, it is common to designate a "well-known location" for such data, so that it can be easily located. However, this approach has the drawback of risking collisions, both with other such designated "well-known locations" and with pre-existing resources.
>
> To address this, this memo defines a path prefix in HTTP(S) URIs for these "well-known locations", "/.well-known/". Future specifications that need to define a resource for such site-wide metadata can register their use to avoid collisions and minimise impingement upon sites' URI space.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading RFC 5785 and the IANA well-known URIs registry linked in the issue, then compare the proposed /.well-known/llms.txt location with the existing /llms.txt convention described by the project. Done means the project has a resolved decision on whether and how this alternative should be supported.

Written by the indexing model from the issue text.

Assessment

Domain
web-dev
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.