aws-samples/sample-genai-on-eks-starter-kit
View on GitHubA comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: 🚀 AI Gateway (LiteLLM) 🤖 LLM Serving (vLLM, SGLang, Ollama) 📊 Vector Databases, 🔍 Embedding Models (TEI) 📈 Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes
- Stars
- 94
- Forks
- 59
- Open beginner issues
- 0
- Indexed issues
- 18
- Avg merge
- 1d 16h
- Merged PRs (30d)
- 8
- Dominant language
- JavaScript
- License
- MIT-0
- Last GitHub push
- Sep 9, 2026
- Latest indexed
- Sep 14, 2026
- Contributing guide
- Contributing guide
- Code of conduct
- Code of conduct
- Beginner labels
- No beginner labels indexed
-
aws-samples/sample-genai-on-eks-starter-kit#6 · 1 comment · 0 reactions · 0 assignees ·
-
Tutorial: Enable EFA Open
aws-samples/sample-genai-on-eks-starter-kit#7 · 0 comments · 0 reactions · 0 assignees ·
-
aws-samples/sample-genai-on-eks-starter-kit#8 · 0 comments · 0 reactions · 0 assignees ·
-
aws-samples/sample-genai-on-eks-starter-kit#9 · 0 comments · 0 reactions · 0 assignees ·
-
Add RAGFlow Open
aws-samples/sample-genai-on-eks-starter-kit#30 · 0 comments · 0 reactions · 1 assignee ·
-
Cleanup Fix Open
aws-samples/sample-genai-on-eks-starter-kit#39 · 0 comments · 0 reactions · 1 assignee ·
-
GPU Hunter Open
aws-samples/sample-genai-on-eks-starter-kit#41 · 0 comments · 0 reactions · 1 assignee ·
-
documentation enhancement llm-d
aws-samples/sample-genai-on-eks-starter-kit#52 · 1 comment · 0 reactions · 1 assignee ·
-
aws-samples/sample-genai-on-eks-starter-kit#69 · 0 comments · 0 reactions · 0 assignees ·
-
aws-samples/sample-genai-on-eks-starter-kit#79 · 0 comments · 0 reactions · 0 assignees ·
-
aws-samples/sample-genai-on-eks-starter-kit#122 · 1 comment · 0 reactions · 0 assignees ·
-
aws-samples/sample-genai-on-eks-starter-kit#123 · 1 comment · 0 reactions · 0 assignees ·
-
aws-samples/sample-genai-on-eks-starter-kit#124 · 1 comment · 0 reactions · 0 assignees ·
-
aws-samples/sample-genai-on-eks-starter-kit#180 · 0 comments · 1 reaction · 0 assignees ·
-
aws-samples/sample-genai-on-eks-starter-kit#182 · 0 comments · 1 reaction · 0 assignees ·
-
aws-samples/sample-genai-on-eks-starter-kit#185 · 0 comments · 0 reactions · 0 assignees ·
-
aws-samples/sample-genai-on-eks-starter-kit#188 · 0 comments · 0 reactions · 0 assignees ·
-
aws-samples/sample-genai-on-eks-starter-kit#201 · 0 comments · 1 reaction · 0 assignees ·