deepspeedai / deepspeedai/DeepSpeed
[Question] codellama 34b inference request.
Open
@awan-10 is already working on this.
Since Sep 5, 2023.
question
- Dominant language
- Python
- Stars
- 43.1k
- Forks
- 5k
- Avg merge
- 4d 15h
- Merged PRs (30d)
- 112
Description
Is your feature request related to a problem? Please describe.
NAN
Describe the solution you'd like
NAN
Describe alternatives you've considered
NAN
Additional context
NAN
At present, the DeepSpeed inference engine does not support Code Llama 34B, are there any plans to incorporate support for it in the future?
### Tasks
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.