aws-samples / aws-samples/sample-genai-on-eks-starter-kit
Feature Request: LLM-D Integration with Kubernetes in AI Gateway
Open
documentation
enhancement
llm-d
- Dominant language
- JavaScript
- Stars
- 94
- Forks
- 59
- Avg merge
- 1d 16h
- Merged PRs (30d)
- 8
Description
There is a request for examples demonstrating how LLM-D can be tightly integrated with Kubernetes in AI Gateway. Adding such examples would be beneficial for users looking to implement this integration.
**Suggested Example Components:**
- Kubernetes deployment manifests for LLM-D
- Configuration for AI Gateway to interact with LLM-D pods
- Resource allocation best practices
- Scaling configurations
- Service mesh integration patterns
Contributor guide
Assessment
This issue has not been assessed yet.