NVIDIA / NVIDIA/NeMo-Retriever
[FEA]: Update REST service to fully support streaming requests/responses
Open
Nobody has claimed this yet.
feature request
- Dominant language
- Python
- Stars
- 3k
- Forks
- 349
- Avg merge
- 1d 23h
- Merged PRs (30d)
- 116
Description
Is this a new feature, an improvement, or a change to existing functionality?
Improvement
How would you describe the priority of this feature request
Significant improvement
Please provide a clear description of problem this feature solves
This is purely an internal change that will help with stability and improved user feedback from the client's perspective. It will likely require updates to how data is retrieved in the REST service from the broker service and streamed back to the client.
Describe the feature, and optionally a solution or implementation and any alternatives
N/A
Additional context
No response
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by tracing how the REST service retrieves data from the broker service and streams responses back to the client. Review the request and response paths together; done means streaming requests and responses are fully supported with the intended stability and client feedback improvements.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- api, backend
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100