NVIDIA / NVIDIA/cudf

[Story] Pass entire Polars unit tests with RapidsMPF

Open
#21,468 0 comments 0 reactions 1 assignee Claimed by @mroeschke View on GitHub
cudf-polars feature request
Dominant language
C++
Stars
9.8k
Forks
1.1k
Avg merge
3d 6m
Merged PRs (30d)
278

Description

Polars unit tests are currently only being tested in `ci/run_cudf_polars_polars_tests.sh` with the in-memory and task-streaming executors. A prerequisite to changing the default runtime to RapidsMPF is ensuring the Polars unit tests pass with fallback with a reasonable amount of exceptions.

The necessary changes include:

- Including an entry in `ci/run_cudf_polars_polars_tests.sh` that runs the Polars unit tests with `--cluster single --runtime rapidsmpf`
- May need to modify `python/cudf_polars/cudf_polars/testing/plugin.py` to enable some dynamic planning option in the command above
- May need to modify `python/cudf_polars/cudf_polars/testing/plugin.py` to add anther mapping like `RAPIDSMPF_ONLY_EXPECTED_FAILURES` for expected failures

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.