NVIDIA / NVIDIA/cccl

[CUCO] Stride tuning for count and retrieve kernels

Open
#9,598 0 comments 0 reactions 0 assignees View on GitHub
cuco cudax
Dominant language
C++
Stars
2.5k
Forks
486
Avg merge
2d 6h
Merged PRs (30d)
295

Description

Similar to https://github.com/NVIDIA/cuCollections/pull/823

The default stride-1 kernel configuration may not deliver the best performance. During the cuco migration, we should invest an effort similar to the `retrieve` optimization to evaluate whether using a larger stride (e.g., 4) can improve performance for `count` and other kernels.

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the cuCollections PR 823 and the current count and retrieve kernel configurations. Benchmark the default stride-1 setup against larger strides such as 4 for count and other relevant kernels; done means performance data supports and identifies any worthwhile tuning.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
hpc, performance
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.