NVIDIA / NVIDIA/NeMo-Retriever

[FEA]: Fully in-process Service query

Open
#2,373 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

feature request next-release
Dominant language
Python
Stars
3k
Forks
349
Avg merge
1d 23h
Merged PRs (30d)
116

Description

Is this a new feature, an improvement, or a change to existing functionality?

Improvement

How would you describe the priority of this feature request

Significant improvement

Please provide a clear description of problem this feature solves

We should be able to run service without an external VDB sidecar when using retriever service mode

Describe the feature, and optionally a solution or implementation and any alternatives

Retriever Service currently requires a separate VDB sidecar for queries; disabling VDB causes query requests to fail with a 404. This complicates ingest-and-query workflows and may require running two services, and potentially loading a second embedding model.

The requested feature is to make VDB support part of the Retriever Service startup flow, ideally through a single command, while preserving compatibility with the existing Helm deployment architecture.

Additional context

No response

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by tracing Retriever Service startup and query handling with VDB disabled, then review the existing Helm deployment architecture. Confirm how VDB should initialize through a single command while preserving the sidecar-compatible path. Done means retriever queries work without an external VDB sidecar and existing Helm deployments remain compatible.

Written by the indexing model from the issue text.

Assessment

Tech stack
helm, python
Domain
backend, databases, devops
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.