[CNCF LFX Proposal] Volcano - Advanced Kthena Workload Lifecycle Management, Routing Visibility, and Operational Observability in Volcano Dashboard

### CNCF Project

Volcano

### Term

2026 Term 3 (Sep-Nov)

### Program Name

Kthena LLM Resource Management in Volcano Dashboard

### Program Description

- Description: Volcano Dashboard already supports Jobs, Queues, Pods, and PodGroups, but Kthena LLM workloads still depend heavily on `kubectl` and separate tooling for day-to-day operations. This project extends the dashboard into a richer operational interface for Kthena by bringing core serving resources into the UI and improving how users inspect, manage, and troubleshoot inference workloads. The mentee should study the existing dashboard architecture and Kthena resource model, then design an experience that covers not only resource management but also deeper operational workflows such as serving status visualization, routing visibility, rollout awareness, resource relationships, and troubleshooting context across Kthena, Volcano, and Kubernetes objects.

- Expected Outcome:
- Dashboard support for major Kthena resources such as ModelServing, ModelBooster, ModelRoute, and ModelServer.
- UI workflows for inspecting and managing those resources.
- Clear visibility into conditions, replicas, rollout state, and relationships to related Pods, PodGroups, Queues, and other underlying resources.
- Improved operational and troubleshooting workflows, including routing visibility and serving health context.
- Required RBAC and deployment updates for practical cluster usage.
- Tests and user-facing documentation.

### Technologies

TypeScript, React, Next.js, Kubernetes API, observability basics, familiarity with Volcano and Kthena

### Skills same as Technologies?

- [x] Yes, the required skills are the same as the technologies listed above.

### Required/Desirable Skills

_No response_

### Mentors

ZhenCheng Lee | @LiZhenCheng9527 | lizhencheng6@huawei.com| LiZhenCheng9527

Kuldeep Singh | @de6p | de6p97@gmail.com | 05cc0d01-c938-4a18-951e-af71be282b2b

Zicong Chen (Jesse Stutler) | @JesseStutler | jessestutler97@gmail.com| ca54663f-6e7b-4839-a779-eaafb23aab59

### Upstream Issue URL

https://github.com/volcano-sh/dashboard/issues/307

### Application Prerequisites

- [x] Resume
- [x] Cover Letter
- [ ] School Enrollment Verification
- [ ] Participation Permission from school or employer
- [x] Coding Challenge
- [x] Custom Prerequisite (fill in details below)

### Coding Challenge URL

https://github.com/volcano-sh/dashboard/issues/308

### Custom Prerequisite Name

Dashboard Authn/z

### Custom Prerequisite Description

Applicants should review this issue and submit a short technical design covering:
1) proposed auth approach for Volcano Dashboard,
2) how user identity maps to Kubernetes RBAC,
3) how the UI should behave for unauthorized access,
4) a high-level implementation and test plan.

### Custom Prerequisite — File Upload

- [x] Yes — completion of this task requires the mentee to submit a file.

---
**LFX program:** [CNCF - Volcano: Kthena LLM Resource Management in Volcano Dashboard (2026 Term 3)](https://mentorship.lfx.linuxfoundation.org/project/b2d21cb7-4380-4375-9384-ca791e652f0d)

Start with upstream issues 307 and 308, then study the existing Volcano Dashboard architecture and the Kthena resource model. Map the requested ModelServing, ModelBooster, ModelRoute, and ModelServer workflows to related Kubernetes resources, RBAC, routing, rollout, and observability needs. Done means the dashboard supports the listed resources and workflows, with deployment updates, tests, and user-facing documentation.

Written by the indexing model from the issue text.