jackMort / jackMort/ChatGPT.nvim

any qery gives response `This model's maximum context length is 16385 tokens. [...]`

Open
#427 2 comments 2 reactions 0 assignees View on GitHub
Dominant language
Lua
Stars
4k
Forks
317
PR merge metrics
No merged PRs in 30d

Description

The full error reads
`This model's maximum context length is 16385 tokens. However, your messages resulted in 16680 tokens. Please reduce the length of the messages.`

This comes for any request (that previously could be executed successfully).

I tried setting the `max_tokens` to 20000 or some other arbitrary value but to no avail.
Using [chatgpt CLI](https://github.com/kardolus/chatgpt-cli) I'm having no problems with the same queries.

What am I missing?

Contributor guide

No contributing guide indexed for this repository

Research direction

Reproduce the error in ChatGPT.nvim with a query that previously worked, then inspect the plugin's request handling and compare its token-related request settings with the chatgpt CLI mentioned in the report. Done means previously successful queries no longer fail with the 16385-token context-length error.

Written by the indexing model from the issue text.

Assessment

Tech stack
lua, neovim
Domain
ai, tooling
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.