NVIDIA / NVIDIA/cccl

[FEA]: Add runtime orchestration for graph-capturable segmented sort

Open
#10,951 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
2.5k
Forks
486
Avg merge
2d 6h
Merged PRs (30d)
295

Description

### Is this a duplicate?

- [x] I confirmed there appear to be no [duplicate issues](https://github.com/NVIDIA/cccl/issues) for this request and that I agree to the [Code of Conduct](CODE_OF_CONDUCT.md)

### Area

CUB

### Is your feature request related to a problem? Please describe.

The segmented-sort work plan is produced on the device, but sizing subsequent kernel grids from exact device counts requires a device-to-host copy and stream synchronization. This prevents CUDA graph capture and adds a host round trip in the middle of the algorithm.

### Describe the solution you'd like

Track the runtime-orchestration work needed to launch the specialized segmented-sort kernels without a host synchronization step:

- [ ] SM-scaled fixed-grid scheduling whose work bounds remain device-resident.
- [ ] PDL evaluation for overlapping independent specialized kernel families.

This tracking issue can be closed once the specialized kernel sequence can consume device-resident work plans without a mid-algorithm host synchronization and has appropriate graph-capture correctness coverage.

### Describe alternatives you've considered

_No response_

### Additional context

- Existing PDL issue: https://github.com/NVIDIA/cccl/issues/6790
- Existing graph-capture design/PoC/evaluation issues: https://github.com/NVIDIA/cccl/issues/10798, https://github.com/NVIDIA/cccl/issues/10799, and https://github.com/NVIDIA/cccl/issues/10800

Contributor guide

Open the contributing guide

Research direction

Start by reading the linked PDL issue 6790 and the graph-capture design, proof-of-concept, and evaluation issues 10798–10800. Determine how segmented-sort's device-produced work plan is consumed and how the specialized kernel sequence can avoid host synchronization. Done means device-resident work plans support graph capture with correctness coverage, including SM-scaled scheduling and PDL evaluation.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
performance
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.