nebari-dev / nebari-dev/llm-serving-pack
Add landing page configuration to LLMModel CRD
Nobody has claimed this yet.
- Dominant language
- Go
- Stars
- 3
- Forks
- 3
- Avg merge
- 16h 31m
- Merged PRs (30d)
- 11
Description
Problem
When a model is deployed, users need a way to access the API UI (e.g. Swagger/OpenAPI docs). There's no way to configure a landing page link for the model from the LLMModel CRD.
Proposal
Add a landing page configuration section to the LLMModel CRD spec that integrates with the nebari landing page, allowing users to discover and access model API endpoints from a central location.
Context
The nebari-landingpage is deployed as part of the foundational services. Models should be able to register themselves with the landing page so users can find and interact with them.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the LLMModel CRD definition and the deployment integration in this repository, then read how the nebari-landingpage is configured among the foundational services. Define the CRD landing page section and its registration behavior so deployed models expose discoverable API endpoints through the landing page.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go, kubernetes
- Domain
- backend, infrastructure
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100