alibaba / alibaba/feathub

Provide utility function to verify DataFrames

Open
#79 0 comments 0 reactions 0 assignees View on GitHub
type:improvement
Dominant language
Python
Stars
350
Forks
60
PR merge metrics
No merged PRs in 30d

Description

Currently, some tests in feathub verify a pandas DataFrame as follows.

```python
self.assertTrue(expected_df.equals(result_df)
```

Such implementation cannot work in certain cases. For example, if an element in the two DataFrames is a dict whose order of entries is different, they are supposed to pass the test, while the current implementation fails in this case.

Thus we should use a better way to verify DataFrames.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the FeatHub tests that compare pandas DataFrames with DataFrame.equals. Review pandas DataFrame comparison behavior for cells containing dictionaries, then add a shared verification utility and update the affected tests so equivalent DataFrames with differently ordered dictionary entries pass.

Written by the indexing model from the issue text.

Assessment

Tech stack
pandas, python
Domain
data, testing
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.