视频转文字后的对话功能,历史对话信息在清空后,仍然会被上传给LLM
Nobody has claimed this yet.
- Dominant language
- No language data
- Stars
- 1.1k
- Forks
- 108
- PR merge metrics
- No merged PRs in 30d
Description
Describe the bug
使用了3,4次转文字的对话(Chat)后,不断提示token过多。即使在完全删除会话后,仍然提示token过多。视频转成的文字大约只有4万左右
To Reproduce
Steps to reproduce the behavior:
- 视频转成文字
- 开始对话功能,并对话多次
- 提示上下文token过长
- 清除历史对话
- 仍然提示token过长
Expected behavior
发生错误:400 This model's maximum context length is 131072 tokens. However, you requested 439561 tokens (431369 in the messages, 8192 in the completion). Please reduce the length of the messages or completion.
Screenshots
发生错误:400 This model's maximum context length is 131072 tokens. However, you requested 439561 tokens (431369 in the messages, 8192 in the completion). Please reduce the length of the messages or completion.
Desktop (please complete the following information):
windows 11, memo 1.6.6
Additional context
Add any other context about the problem here.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Reproduce the issue in MemoAI 1.6.6 using the listed video-to-text and chat steps, then inspect what is sent to the LLM before and after clearing the conversation history. Done means deleted history is no longer included in the request and the context-token error no longer occurs.
Written by the indexing model from the issue text.
Assessment
- Domain
- ai
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100