microsoft / microsoft/simplechat
max_token in route_backend_chat
- Dominant language
- Python
- Stars
- 152
- Forks
- 116
- Avg merge
- 7h 7m
- Merged PRs (30d)
- 122
Description
Note: Two summary calls in route_backend_chats.py have the same max_tokens usage, but they're wrapped in try/except and fail silently (chat still works, just without summarization). These only trigger on long conversations with specific admin settings enabled. The main chat call doesn't set any token limit so it works fine with all models.
Contributor guide
Research direction
Start in route_backend_chats.py and inspect the two summary calls that pass max_tokens, then reproduce the long-conversation path with the relevant admin settings. The issue does not define the intended replacement behavior or a test, so confirm those expectations before changing code; done should include coverage for the summary path without affecting normal chat.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai, backend
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100