NVIDIA / NVIDIA/cudf

[FEA] `PythonScan` support row-limits in multi-rank GPU execution

Open
#22,918 0 comments 0 reactions 0 assignees View on GitHub
cudf-polars feature request
Dominant language
C++
Stars
9.8k
Forks
1.1k
Avg merge
3d 6m
Merged PRs (30d)
278

Description

## Summary

cudf-polars currently rejects pushed-down row limits on `PythonScan` sources, falling back to the CPU engine. The underlying issue is that a single global row limit cannot be enforced independently on each rank of a distributed query. This issue tracks adding proper distributed support so that `head`, `limit`, and `tail` (surfaced as `n_rows`) work correctly across ranks instead of being rejected.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.