twosigma / twosigma/flint

"joinLeft" returns dataframe that smaller than left_df

Open
#78 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Scala
Stars
1.2k
Forks
199
PR merge metrics
No merged PRs in 30d

Description

Hi all:

I found that **leftJoin** generates df that smaller than the left df

```
[In] [1]: joined_flint = left_flint.leftJoin(right_flint, tolerance=tolerance, key=by)
[In] [2]: print (joined_flint.count() < left_flint.count())
True
```

I consider this is a false result since left join does not drop any row in the left table.
Any explanation or suggestion?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.