aws-samples / aws-samples/sample-genai-on-eks-starter-kit
Look at how to use KTransformers for Hybrid GPU + CPU
Open
- Dominant language
- JavaScript
- Stars
- 94
- Forks
- 59
- Avg merge
- 1d 16h
- Merged PRs (30d)
- 8
Description
Take a look at this [SGLang KTransformers discussion](https://github.com/sgl-project/sglang/issues/11425). See if we can leverage this for hybrid GPU & CPU solution.
Contributor guide
Research direction
Start by reading the linked SGLang KTransformers discussion, then compare its hybrid GPU and CPU approach with this repository's Amazon EKS deployment scope. No files or tests are named; done should be a documented feasibility result with a clearly defined integration plan or a reason not to proceed.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- kubernetes
- Domain
- ai, infrastructure
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100