NVIDIA / NVIDIA/cudf

[FEA][JNI] Leverage cub's multi-buffer copy algorithm in JNI bindings

Open
#12,899 1 comment 0 reactions 1 assignee Claimed by @abellina View on GitHub
0 - Backlog feature request Java Performance Spark
Dominant language
C++
Stars
9.8k
Forks
1.1k
Avg merge
3d 6m
Merged PRs (30d)
278

Description

We would like to use https://github.com/NVIDIA/cub/issues/297 for our spilling logic https://github.com/NVIDIA/spark-rapids/issues/7672 in the spark-rapids plugin.

We currently contiguous_split every single buffer that _could be_ spilled in the future, because at the time of spill the last thing we want to do is double our memory usage right before copying to host. The multi-buffer work should allow us to bounce-buffer out of GPU memory at spill time, without having to contiguous_split for spillable buffers.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.