apache / apache/arrow

[C++][GPU] Writing sliced GPU record batches to IPC

Open
#43,029 6 comments 0 reactions 0 assignees View on GitHub
Component: C++ Component: GPU Type: enhancement
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

### Describe the enhancement requested

Currently, it isn't possible to write GPU-memory backed record batches to IPC if they are sliced. When Arrays are sliced, the null-count is set to a sentinel to indicate "UNKNOWN" rather than recompute it immediately. We need to add some interfaces to the GPU / MemoryManager / Device libraries to perform the bit counting and copying of bitmaps to handle sliced arrays properly and write them to IPC when they are using device memory.

### Component(s)

C++, GPU

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.