NVIDIA / NVIDIA/NeMo-Retriever
[FEA]: Progress bar for python client
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 3k
- Forks
- 349
- Avg merge
- 1d 23h
- Merged PRs (30d)
- 116
Description
Is this a new feature, an improvement, or a change to existing functionality?
New Feature
How would you describe the priority of this feature request
Significant improvement
Please provide a clear description of problem this feature solves
The NV-Ingest cli client displays a progress bar that shows real time ingestion progress in terms of files ingested along with metrics like time per file and pages per second when performing ingestion jobs. We now have the ability to ingest multiple files at a time with the python client, but it doesn't display progress like the cli. This becomes an issue for large jobs where it's hard to determine the job's progress.
Describe the feature, and optionally a solution or implementation and any alternatives
I would like for the python client to display similar progress information as the cli when performing multi file ingestion jobs.
Additional context
No response
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files, tests, or entry points are named. Start by locating the Python client's multi-file ingestion path and comparing it with the CLI's existing progress display; done means large multi-file jobs show ingestion progress, time per file, and pages per second.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- cli, data-engineering
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100