Add fused MatMul from cublasLt
Open
Nobody has claimed this yet.
enhancement
gpu
help wanted
- Dominant language
- C++
- Stars
- 4.7k
- Forks
- 536
- Avg merge
- 12h 12m
- Merged PRs (30d)
- 4
Description
The MatMul API from cublasLt can be configured to also add the bias and apply ReLU. We should look into this.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No source file or test is named. Start by reviewing the linked cublasLt MatMul API and locating the existing MatMul entry point in CTranslate2; determine how bias addition and ReLU fusion would fit. Done means supporting the configured fused MatMul behavior with coverage for the new operation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- machine-learning, performance
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100