[FEA] Add `PartitionedSink` support to cudf-polars
- Dominant language
- C++
- Stars
- 9.8k
- Forks
- 1.1k
- Avg merge
- 3d 6m
- Merged PRs (30d)
- 278
Description
**Is your feature request related to a problem? Please describe.**
Support for hive-style partitioned sinks
```python
lf.sink_parquet(pl.PartitionBy("./output/", key=["year", "month"]))
# writes: ./output/year=2024/month=01/00000001.parquet
# ./output/year=2024/month=02/00000001.parquet
# ...
```
**Describe the solution you'd like**
A new dedicated IR node: `PartitionedSink`.
**Describe alternatives you've considered**
We could use existing `Sink` but I don't like that because I think `Sink` and `PartitionedSink` will be different enough that they warrant different IR.
**Additional context**
Depends on polars changes, so will need a new pinning first PR
Contributor guide
Assessment
This issue has not been assessed yet.