openai / openai/openai-openapi
system fingerprint is None for some models, but not others
Nobody has claimed this yet.
- Dominant language
- No language data
- Stars
- 2.5k
- Forks
- 527
- Avg merge
- 1h 46m
- Merged PRs (30d)
- 2
Description
Per the documentation here, the OpenAI API should return a system_fingerprint. However, when calling any model that is not gpt-3.5-turbo-1106 or gpt-4-1106-preview, the system_fingerprint is always None.
The link above doesn't mention any model requirement.
Please update the code to return a system fingerprint for earlier models, or else document in the API which models are actually supported.
To Reproduce
copy and paste notebook here
change this line to an older model:
GPT_MODEL = "gpt-3.5-turbo-1106"
For example:
GPT_MODEL = "gpt-3.5-turbo-0613"
the system_fingerprint returned is None
OS-Ubuntu
Python version- Python v3.10
Library version- openai v1.6.1
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the linked deterministic-outputs notebook and the OpenAI API chat object reference, then reproduce the missing system_fingerprint using gpt-3.5-turbo-0613 instead of gpt-3.5-turbo-1106. Done means the supported model requirements are clarified in the API specification or the reported behavior is corrected for earlier models.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- api, documentation
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100