Routing to Local Models problem
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 5.5k
- Forks
- 433
- PR merge metrics
- No merged PRs in 30d
Description
This MF is initialized with a fixed model, and the win rate is calculated based on these internally defined values, rather than using the model information from the external model_pair. The external model_pair simply decides which model to return at the time of routing decision, and does not participate in the win rate calculation. Isn't that a little wrong?
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No file or test is named. Start by locating the MF initialization, its internally defined model values, and the routing path that receives external model_pair; compare how each supplies data to the win-rate calculation. Done means the model-pair behavior and win-rate calculation are consistently resolved and verified in the relevant evaluation flow.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100