Context Extension with Ctranslate2
Open
Nobody has claimed this yet.
- Dominant language
- C++
- Stars
- 4.7k
- Forks
- 536
- Avg merge
- 12h 12m
- Merged PRs (30d)
- 4
Description
Hey,
I am currently stuck if I want to enable rope scaling for Llama-2 models.Is it supported? I went through the documentation but there is not enough guidance on how to go about this.
Any help would be much appreciated. Thankyou.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the CTranslate2 documentation and the existing Llama-2 model support for rope scaling and context extension. Done means determining whether rope scaling is supported and documenting the configuration steps or limitations clearly enough for users to follow.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- machine-learning
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100