NVIDIA / NVIDIA/cccl

Increase CUB/Thrust benchmark problem sizes

Open
#6,813 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
2.5k
Forks
486
Avg merge
2d 6h
Merged PRs (30d)
295

Description

The benchmarks for CUB and Thrust usually pick the problem sizes 2^16, 2^20, 2^24 and 2^28. The largest size using `int32` results in 1GiB of memory used (per input), which is not a large workload on recent data center grade GPUs. On B200 for the new warpspeed scan implementation it was barely large enough to hide the constant overheads of the kernel and reach SOL.

We should strongly consider adding a larger benchmark size, e.g. 2^32, which is only executed for 64-bit offset types. Since this may fail to allocate on some GPUs of interest, we should then gracefully skip the benchmark if not enough memory is available.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.