NVIDIA / NVIDIA/cudf

[FEA] Expand pinned memory use in libcudf

Open
#15,616 0 comments 1 reaction 0 assignees View on GitHub
feature request libcudf Performance
Dominant language
C++
Stars
9.8k
Forks
1.1k
Avg merge
3d 6m
Merged PRs (30d)
278

Description

Once https://github.com/rapidsai/cudf/issues/15612 is implemented, libcudf can make further use of the pool to optimize data transfers.

Types like `device_scalar` can use a small pinned buffer, since pool makes the allocation cost trivial. Also, use of `std::vector`s as the host mirror of device data (e.g. `make_device_uvector_async`, `make_std_vector_async`) can be replaced with a type backed with pinned memory, at least for buffers that are not in the same order of magnitude with the data size.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.