explosion / explosion/spacy-llm
Add a "conversational_history" option in openai llm model
- Dominant language
- Python
- Stars
- 1.4k
- Forks
- 110
- PR merge metrics
- No merged PRs in 30d
Description
Hi,
I use the openai llm model in production, and we would like to incorporate conversational history with the ChatML approach, with the User/Assistant alternating streams that openai supports:
`
[{"role": "user", "content": messge1},{"role": "assistant", "content": messge2},{"role": "user", "content": messge3},{"role": "assistant", "content": messge4},]`
Such that we could provide a list of dicts and update the sent request by appending before the request with the current prompt
https://github.com/explosion/spacy-llm/blob/117f68963870fd2a4af4c706c40cf223c6ae6fde/spacy_llm/models/rest/openai/model.py#L129
So I was wondering if that parameter could be added to the OPENAI rest model
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.