[FEA] Expand pinned memory use in libcudf
Open
feature request
libcudf
Performance
- Dominant language
- C++
- Stars
- 9.8k
- Forks
- 1.1k
- Avg merge
- 3d 6m
- Merged PRs (30d)
- 278
Description
Once https://github.com/rapidsai/cudf/issues/15612 is implemented, libcudf can make further use of the pool to optimize data transfers.
Types like `device_scalar` can use a small pinned buffer, since pool makes the allocation cost trivial. Also, use of `std::vector`s as the host mirror of device data (e.g. `make_device_uvector_async`, `make_std_vector_async`) can be replaced with a type backed with pinned memory, at least for buffers that are not in the same order of magnitude with the data size.
Contributor guide
Assessment
This issue has not been assessed yet.