nebari-dev/llm-serving-pack
View on GitHubSelf-hosted LLM serving via llm-d. Includes per-model OIDC access control, API key management, and Envoy AI Gateway token counting and rate limiting.
- Stars
- 3
- Forks
- 3
- Open beginner issues
- 0
- Indexed issues
- 40
- Avg merge
- 16h 31m
- Merged PRs (30d)
- 11
- Dominant language
- Go
- License
- Apache-2.0
- Last GitHub push
- Sep 18, 2026
- Latest indexed
- Sep 19, 2026
- Contributing guide
- Contributing guide
- Code of conduct
- Code of conduct
- Beginner labels
- good first issue
-
Add nodeSelector, tolerations and imagePullSecrets for the EPP under spec.advanced.inferencePool Openneeds: discussion π¬
Difficulty 4/5 3-5 days Newbie friendliness 68/100
nebari-dev/llm-serving-pack#176 Β·
-
type: deprecation β°οΈ
Difficulty 4/5 3-5 days Newbie friendliness 64/100
nebari-dev/llm-serving-pack#175 Β· 2 comments Β·
-
type: bug π
Difficulty 4/5 3-5 days Newbie friendliness 68/100
nebari-dev/llm-serving-pack#174 Β·
-
priority: medium β‘ UI/UX/DX
Difficulty 5/5 Over a week Newbie friendliness 45/100
nebari-dev/llm-serving-pack#152 Β· 1 comment Β·
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
nebari-dev/llm-serving-pack#148 Β·
-
priority: high π₯ security type: enhancement π πΌ
Difficulty 4/5 3-5 days Newbie friendliness 52/100
nebari-dev/llm-serving-pack#136 Β·
-
priority: medium β‘ security type: enhancement π πΌ
Difficulty 3/5 1-2 days Newbie friendliness 58/100
nebari-dev/llm-serving-pack#135 Β·
-
priority: high π₯ security type: enhancement π πΌ
Difficulty 5/5 Over a week Newbie friendliness 25/100
nebari-dev/llm-serving-pack#134 Β·
-
Difficulty 4/5 3-5 days Newbie friendliness 48/100
nebari-dev/llm-serving-pack#124 Β·
-
Difficulty 2/5 1-3 hours Newbie friendliness 25/100
nebari-dev/llm-serving-pack#123 Β·
-
Per-model API-key scoping broken when one user has keys for multiple models (colliding client IDs) Open
Difficulty 2/5 1-3 hours Newbie friendliness 25/100
nebari-dev/llm-serving-pack#122 Β·
-
Difficulty 1/5 Under an hour Newbie friendliness 25/100
nebari-dev/llm-serving-pack#121 Β·
-
priority: medium β‘ type: bug π
Difficulty 3/5 1-2 days Newbie friendliness 75/100
nebari-dev/llm-serving-pack#110 Β· 1 comment Β·
-
priority: medium β‘ type: maintenance π
Difficulty 3/5 1-2 days Newbie friendliness 72/100
nebari-dev/llm-serving-pack#109 Β·
-
good first issue priority: low π± type: enhancement π πΌ UI/UX/DX
Difficulty 4/5 3-5 days Newbie friendliness 52/100
nebari-dev/llm-serving-pack#106 Β·
-
area: documentation π priority: medium β‘ type: maintenance π
Difficulty 3/5 1-2 days Newbie friendliness 52/100
nebari-dev/llm-serving-pack#104 Β·
-
priority: medium β‘ type: enhancement π πΌ
Difficulty 4/5 3-5 days Newbie friendliness 45/100
nebari-dev/llm-serving-pack#87 Β·
-
priority: high π₯ type: enhancement π πΌ
Difficulty 4/5 3-5 days Newbie friendliness 48/100
nebari-dev/llm-serving-pack#86 Β·
-
AI Gateway webhook cert becomes untrusted after pod rescheduling, blocking envoy proxy creation Openneeds: investigation π priority: high π₯ type: bug π
Difficulty 4/5 3-5 days Newbie friendliness 48/100
nebari-dev/llm-serving-pack#84 Β· 3 comments Β·
-
epic
Difficulty 5/5 Over a week Newbie friendliness 30/100
nebari-dev/llm-serving-pack#81 Β·
-
epic
Difficulty 4/5 3-5 days Newbie friendliness 38/100
nebari-dev/llm-serving-pack#80 Β·
-
epic
Difficulty 4/5 3-5 days Newbie friendliness 42/100
nebari-dev/llm-serving-pack#79 Β·
-
epic
Difficulty 5/5 Over a week Newbie friendliness 25/100
nebari-dev/llm-serving-pack#78 Β·
-
priority: medium β‘ type: enhancement π πΌ
Difficulty 4/5 3-5 days Newbie friendliness 52/100
nebari-dev/llm-serving-pack#69 Β· 1 comment Β·
-
area: ci π·π½ββοΈ area: testing β priority: medium β‘ type: maintenance π
Difficulty 4/5 3-5 days Newbie friendliness 48/100
nebari-dev/llm-serving-pack#68 Β·
-
priority: high π₯ type: enhancement π πΌ
Difficulty 5/5 Over a week Newbie friendliness 35/100
nebari-dev/llm-serving-pack#67 Β·
-
priority: high π₯ type: enhancement π πΌ
Difficulty 4/5 3-5 days Newbie friendliness 45/100
nebari-dev/llm-serving-pack#66 Β·
-
needs: follow-up π₯ needs: PR π¬ priority: high π₯ type: enhancement π πΌ
Difficulty 5/5 Over a week Newbie friendliness 35/100
nebari-dev/llm-serving-pack#55 Β·
-
area: documentation π needs: documentation π needs: follow-up π₯ priority: medium β‘ type: maintenance π
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
nebari-dev/llm-serving-pack#54 Β·
-
area: developer experience π©π»βπ» needs: follow-up π₯ priority: low π± type: maintenance π
Difficulty 4/5 3-5 days Newbie friendliness 25/100
nebari-dev/llm-serving-pack#53 Β·
-
area: testing β good first issue needs: follow-up π₯ priority: low π± type: maintenance π
Difficulty 3/5 1-2 days Newbie friendliness 48/100
nebari-dev/llm-serving-pack#52 Β·
-
area: documentation π needs: follow-up π₯ priority: medium β‘ type: maintenance π
Difficulty 3/5 1-2 days Newbie friendliness 52/100
nebari-dev/llm-serving-pack#51 Β·
-
area: documentation π needs: follow-up π₯ needs: investigation π priority: medium β‘ type: bug π
Difficulty 4/5 3-5 days Newbie friendliness 48/100
nebari-dev/llm-serving-pack#50 Β·
-
area: developer experience π©π»βπ» good first issue needs: follow-up π₯ priority: medium β‘ type: maintenance π
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
nebari-dev/llm-serving-pack#49 Β·
-
area: developer experience π©π»βπ» good first issue needs: follow-up π₯ priority: low π± type: maintenance π
Difficulty 3/5 1-2 days Newbie friendliness 78/100
nebari-dev/llm-serving-pack#48 Β·
-
priority: medium β‘ type: enhancement π πΌ
nebari-dev/llm-serving-pack#44 Β· 3 comments Β· 1 assignee Β·
-
priority: medium β‘ type: enhancement π πΌ
Difficulty 4/5 3-5 days Newbie friendliness 45/100
nebari-dev/llm-serving-pack#43 Β·
-
priority: low π± type: enhancement π πΌ
Difficulty 5/5 Over a week Newbie friendliness 30/100
nebari-dev/llm-serving-pack#42 Β·
-
priority: low π± type: maintenance π
Difficulty 3/5 1-2 days Newbie friendliness 58/100
nebari-dev/llm-serving-pack#40 Β·
-
epic
Difficulty 5/5 Over a week Newbie friendliness 30/100