NVIDIA / NVIDIA/cccl

[FEA]: Multi-Device Memory Resource and Buffer Example

Open
#5,713 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
2.5k
Forks
486
Avg merge
2d 6h
Merged PRs (30d)
295

Description

Implement a memory resource type holding a resource per device (optionally a pool per device, exposed as shared resource). Resource passes allocation to device pool/resource based on stream/device. Implement `multi_device_async_buffer` inheriting from `async_buffer` and holding the resource. Show how `switch_stream` reallocates/copies memory asynchronously to a new device if needed.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.