Generalize drop_nulls fusion
Open
cudf-polars
improvement
Performance
- Dominant language
- C++
- Stars
- 9.8k
- Forks
- 1.1k
- Avg merge
- 3d 6m
- Merged PRs (30d)
- 278
Description
question: How general can we apply this to other pylibcudf aggregations that accept `null_policy` (e.g count, rank, distinct_count),
https://github.com/rapidsai/cudf/pull/22014 fuses `drop_nulls` and `n_unique` into a single pylibcudf call because `n_unique` supports null handling natively. We may be able to apply the same optimization to other operators where pylibcudf natively supports `n_unique` as well.
Contributor guide
Assessment
This issue has not been assessed yet.