NVIDIA / NVIDIA/cudf

[FEA] Decompose null_count (and len) expressions as summing Literals on CPU in cudf_polars

Open
#22,153 0 comments 0 reactions 0 assignees View on GitHub
cudf-polars feature request
Dominant language
C++
Stars
9.8k
Forks
1.1k
Avg merge
3d 6m
Merged PRs (30d)
278

Description

From https://github.com/rapidsai/cudf/pull/22126#discussion_r3083332842, an alternative idea when decomposing a null count expression is to create `Literal` expressions and sum the `Literal.value`s on the CPU to avoid allocating GPU memory since the `Column`s already advertise their `.null_count` (i.e. a computation we don't necessarily need the GPU for?)

Possibly something can also apply for decomposing a `Len` expression since the `Column`s already advertise their `.size`

Not currently confident all the pieces are in place to do this today.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.