NVIDIA / NVIDIA/cuCollections

[ENHANCEMENT]: Enable PDL for all cuco kernels

Open
#785 5 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

good first issue helps: rapids P1: Should have topic: performance type: improvement
Dominant language
Cuda
Stars
667
Forks
120
Avg merge
7d 5h
Merged PRs (30d)
4

Description

The Programmatic Dependent Launch (PDL) mechanism allows for a dependent secondary kernel to launch before the primary kernel it depends on in the same CUDA stream has finished executing. Available starting with devices of compute capability 9.0, this technique can provide performance benefits when the secondary kernel can complete significant work that does not depend on the results of the primary kernel.

Cuco kernels should all support PDL.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the CUDA Programmatic Dependent Launch documentation linked in the issue, then inventory the cuco kernels and their launch paths. Determine the changes and validation needed for each kernel to support PDL on compute capability 9.0 and newer; the work is done when all cuco kernels support the mechanism.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
performance
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.