aws-samples / aws-samples/sample-genai-on-eks-starter-kit

Feature Request: LLM-D Integration with Kubernetes in AI Gateway

Open
#52 1 comment 0 reactions 1 assignee Claimed by @devfloor9 View on GitHub
documentation enhancement llm-d
Dominant language
JavaScript
Stars
94
Forks
59
Avg merge
1d 16h
Merged PRs (30d)
8

Description

There is a request for examples demonstrating how LLM-D can be tightly integrated with Kubernetes in AI Gateway. Adding such examples would be beneficial for users looking to implement this integration.

**Suggested Example Components:**
- Kubernetes deployment manifests for LLM-D
- Configuration for AI Gateway to interact with LLM-D pods
- Resource allocation best practices
- Scaling configurations
- Service mesh integration patterns

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.