Tensor Parallel and Context Parallel
Open
Nobody has claimed this yet.
Feature Request
triaged
- Dominant language
- C++
- Stars
- 13.4k
- Forks
- 2.4k
- Avg merge
- 5d 3h
- Merged PRs (30d)
- 2
Description
Is there a plan to support the Tensor Parallel and Context Parallel? I think this would make the project more flexible and attract more users.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files, tests, or entry points are named. Start by surveying TensorRT's existing support for tensor and context parallelism, then clarify the requested scope with the issue thread. Done would require a defined support goal and implementation plan, which the issue does not currently provide.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- distributed-systems, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100