simonw / simonw/llm

[BUG?] cannot use specific snapshots of GPT-4

Open
#362 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
12.5k
Forks
998
Avg merge
3d 13h
Merged PRs (30d)
10

Description

❯ llm -m gpt-4-0314 hi                                                             
Error: 'gpt-4-0314' is not a known model

❯ llm -m gpt-4-0613 hi
Error: 'gpt-4-0613' is not a known model
❯ llm -m gpt-4 hi                                                                  
Hello! How can I assist you today?
❯ llm openai models | rg gpt                                                       
gpt-4                            openai             2023-06-27T16:13:31
gpt-4-vision-preview             system             2023-11-02T03:15:17
gpt-4-0314                       openai             2023-06-27T16:13:30
gpt-4-0613                       openai             2023-06-12T16:54:56
gpt-3.5-turbo                    openai             2023-02-28T18:56:42
gpt-3.5-turbo-1106               system             2023-11-02T21:15:48
gpt-3.5-turbo-0613               openai             2023-06-12T16:30:34
gpt-3.5-turbo-0301               openai             2023-03-01T05:52:43
gpt-3.5-turbo-16k-0613           openai             2023-05-30T19:17:27
gpt-4-1106-preview               system             2023-11-02T20:33:26
gpt-3.5-turbo-instruct           system             2023-08-24T18:23:47
gpt-3.5-turbo-instruct-0914      system             2023-09-07T21:34:32
gpt-3.5-turbo-16k                openai-internal    2023-05-10T22:35:02

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by tracing how the llm -m command resolves model names, then compare that lookup with the models shown by llm openai models. Reproduce the failures for gpt-4-0314 and gpt-4-0613; done means those listed snapshot names can be selected successfully.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, cli
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.