[FEA] Add --pareto-from option in cuVS-bench runner
Nobody has claimed this yet.
- Dominant language
- Cuda
- Stars
- 854
- Forks
- 236
- Avg merge
- 3d 3h
- Merged PRs (30d)
- 62
Description
While cuVS-bench is great for running exhaustive grid searches, it becomes tedious and time consuming having to rerun the full grid searches every single time, especially when a Pareto might have already been computed previously.
Adding a --Pareto-from option allow the user to specify the extracted csv file of the Pareto results. When this option is specified, the default behavior of pulling param configs from the yaml file would be overridden, and instead only the param combinations from the csv file of the Pareto frontier would be executed.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the cuVS-bench runner and the code that currently reads parameter combinations from the YAML configuration. Trace how Pareto results are represented in the extracted CSV, then define the option's precedence and validation. Done means the runner accepts the Pareto CSV and executes only its parameter combinations instead of the full YAML grid.
Written by the indexing model from the issue text.
Assessment
- Domain
- cli
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100