pytorch / pytorch/executorch

Revamp export llm documentation

Open
#14,550 1 comment 0 reactions 1 assignee View on GitHub

@larryliu0820 is already working on this.

Since Sep 30, 2025.

Dominant language
Python
Stars
5k
Forks
1.2k
Avg merge
2d 10h
Merged PRs (30d)
581

Description

📚 The doc issue

https://docs.pytorch.org/executorch/1.0/llm/getting-started.html

Currently we have 2 sections:

The first one uses etLLM and the second one shows up an example with nano-gpt. We should think about the content and ordering of these export documentations.

I would think we want 3 options:

  • Exporting LLM using etLLM recipes
    • Only support a handful models but have the best performance, good backend support
  • Exporting LLM using optimum-executorch
    • Good integration with transformers model zoo but limited quantization and backend support
  • Exporting custom LLM
    • Most flexible, but very advanced and for power users only.
Suggest a potential alternative/fix

No response

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.