simonw / simonw/llm

Model inconsistency in the README

Open
#295 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
12.5k
Forks
998
Avg merge
3d 13h
Merged PRs (30d)
10

Description

Working through the README:

Then download the 15GB Llama 2 13B model like this:

llm mlc download-model Llama-2-7b-chat --alias llama2

It looks like you updated the README from a 7B model to a 13B model at some point, but didn't change that particular command.

(As someone running this on an underpowered M1 with 8 gigs of ram, having the intro tutorial be a 7B model feels like a good default), but either way, it should probably be consistent.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Open the README and compare the introductory text naming the 13B model with the llm mlc download-model Llama-2-7b-chat --alias llama2 command. Make the model size and command consistent, then review the surrounding tutorial text to confirm the documented default is unambiguous.

Written by the indexing model from the issue text.

Assessment

Domain
cli, documentation
Issue type
Documentation
Difficulty
1/5
Estimated time
Under an hour
Activity status
Stale
Clarity
Clearly specified
Newbie friendliness
40/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.