NVIDIA / NVIDIA/cudf

Generalize drop_nulls fusion

Open
#22,102 0 comments 0 reactions 0 assignees View on GitHub
cudf-polars improvement Performance
Dominant language
C++
Stars
9.8k
Forks
1.1k
Avg merge
3d 6m
Merged PRs (30d)
278

Description

question: How general can we apply this to other pylibcudf aggregations that accept `null_policy` (e.g count, rank, distinct_count),

https://github.com/rapidsai/cudf/pull/22014 fuses `drop_nulls` and `n_unique` into a single pylibcudf call because `n_unique` supports null handling natively. We may be able to apply the same optimization to other operators where pylibcudf natively supports `n_unique` as well.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.