NVIDIA / NVIDIA/cudf

[FEA] Support multi-partition `Filter` operations containing non-pointwise expressions

Open
#20,076 0 comments 0 reactions 0 assignees View on GitHub
cudf-polars feature request
Dominant language
C++
Stars
9.8k
Forks
1.1k
Avg merge
3d 6m
Merged PRs (30d)
278

Description

**Is your feature request related to a problem? Please describe.**
Motivated by https://github.com/rapidsai/cudf/pull/20075

We don't currently support non-pointwise filters for multiple partitions. E.g.:

```python
q = df.filter(pl.col("total_revenue") == pl.col("total_revenue").max())
```

**Describe the solution you'd like**
We can probably re-use the expression-decomposition logic we already use for `Select` operations.

**Describe alternatives you've considered**
Rely on single-partition fallback.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.