huggingface / huggingface/candle
Support for Microsoft Phi-3 128k context length
Open
- Dominant language
- Rust
- Stars
- 21k
- Forks
- 1.8k
- Avg merge
- 16h 42m
- Merged PRs (30d)
- 25
Description
Please allow to use `microsoft/Phi-3-mini-128k-instruct` model in the [candle-phi](https://github.com/huggingface/candle/tree/main/candle-examples/examples/phi) example, which uses the LongRope scaling. Thanks!
Contributor guide
No contributing guide indexed for this repository
Research direction
Start in candle-examples/examples/phi and inspect how model variants are selected and how context scaling is configured. Verify support for microsoft/Phi-3-mini-128k-instruct with LongRope scaling by running the candle-phi example and confirming the model loads and operates at the requested context length.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100