nebari-dev / nebari-dev/rayserve-pack

Stable Serve Service can route to pods without a Serve proxy

Open
#36 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Makefile
Stars
1
Forks
4
Avg merge
3d 14h
Merged PRs (30d)
5

Description

Bug

In a private development environment, the stable Serve Service (<release>-nebari-rayserve-serve-svc) selected every Ray pod, but port 8000 was listening only on pods running a Serve proxy. Requests therefore failed intermittently with connection refused, depending on the selected endpoint.

The pack also renders this Service with a head-only selector, while the KubeRay RayService controller reconciles the same Service name with its own ray.io/cluster and ray.io/serve selector. This leaves Helm/Argo CD and KubeRay writing the same resource.

Impact

The documented stable Serve endpoint is unreliable for model traffic.

Potential fixes

  • Let KubeRay exclusively own the canonical -serve-svc Service and ensure its selected pods run Serve proxies; or
  • Give the chart-owned Service a distinct name and select only proxy-bearing pods.

Either approach should leave one writer for the Service and include a test that all selected endpoints accept traffic on port 8000.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by tracing the chart-rendered stable Serve Service and the KubeRay RayService controller's reconciliation of the same Service name. Choose an ownership or naming approach, then verify that the resulting selector targets only Serve-proxy pods and add the requested test showing all selected endpoints accept traffic on port 8000.

Written by the indexing model from the issue text.

Assessment

Tech stack
helm, kubernetes
Domain
infrastructure
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.