dask / dask/distributed

Dataframe shuffle: Behaviour for NULL partitions differs from Pandas 3

Open
#9,184 1 comment 0 reactions 0 assignees View on GitHub
bug p2 shuffle
Dominant language
Python
Stars
1.7k
Forks
778
Avg merge
2h 50m
Merged PRs (30d)
3

Description

> FAILED distributed/shuffle/tests/test_shuffle.py::test_handle_null_partitions_2 - AssertionError: Attributes of DataFrame.iloc[:, 1] (column name="b") are different

> Attribute "dtype" are different
> [left]: )>
> [right]: float64

This test has been broken since the day Pandas 3 was released:

Image

Note that the 3.10 environment still uses pandas 2.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.