NVIDIA / NVIDIA/nvbench

Add benchmark groups/sets/tags

Open
#81 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

P2: nice to have type: enhancement
Dominant language
Cuda
Stars
927
Forks
123
Avg merge
2d 10h
Merged PRs (30d)
2

Description

It would enable a nicer (shorter) way of specifying benchmarks in the CLI interface if one could define groups/sets of benchmarks in the source code.

One way of doings this could be to leverage existing namespaces, i.e. being able to call bench --namespace foo to execute all benchmarks in that namespace (and sub-namespaces). Although I don't know how easy this is to implement compared to just adding a new class.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the CLI benchmark-selection entry point and the source-code definitions for benchmarks. Compare the proposed namespace approach with the alternative of adding a new class, then establish how groups, sets, or tags should be selected and how nested namespaces should behave. Done means the CLI can select the intended benchmark collections consistently.

Written by the indexing model from the issue text.

Assessment

Domain
cli
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.