[FEA] BSDG: Evaluate Paretos across different build configurations
Open
Nobody has claimed this yet.
feature request
- Dominant language
- Cuda
- Stars
- 854
- Forks
- 236
- Avg merge
- 3d 3h
- Merged PRs (30d)
- 62
Description
BSDG (Billion Scale Data Generator)
Our focus has been build once -> sweep search params -> plot pareto
We need to properly evaluate Pareto frontiers as a union of build params and search sweep.
Comparison Methodology: https://docs.nvidia.com/cuvs/user-guide/benchmarking-guide/methodologies#fair-comparisons
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by tracing the BSDG workflow from build configuration through search-parameter sweeps and Pareto plotting. Read the linked comparison methodology to determine how build parameters and search sweeps should be combined; done means Pareto frontiers are evaluated as their union across different build configurations.
Written by the indexing model from the issue text.
Assessment
- Domain
- performance
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100