apache / apache/beam

Some DataFrame operations yield incorrect proxies

Open
#20,926 0 comments 0 reactions 0 assignees View on GitHub
bug core dataframe dsl P3 python
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
2d 2h
Merged PRs (30d)
205

Description

There are some operations that yield proxies which do not match the data they produce at runtime. We should add tests that verify proxies match, and fix the operations where they dont.

Imported from Jira [BEAM-12379](https://issues.apache.org/jira/browse/BEAM-12379). Original Jira may contain additional context.
Reported by: bhulette.

Contributor guide

Open the contributing guide

Research direction

Start by locating the DataFrame operation implementations and any existing proxy-related tests. Reproduce cases where a proxy does not match the runtime data, then add coverage for those operations and fix the mismatches. Done means the tests verify that each proxy matches the data produced at runtime.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data-engineering
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.