apache / apache/gluten

[Flink] Support comparing UT (Unit Test) results with Flink.

Open
#10,062 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

### Description

Currently, we verify UT results by providing expected outcomes. This approach lacks flexibility for two main reasons:
- manually specifying expected results is cumbersome, and
- as Flink evolves, its execution results may change. In such cases, we must manually update the previously provided expected results to maintain consistency.

We aim to achieve an effect similar to Spark's, where UTs are executed once in both Flink and Gluten, and their results are compared.

### Gluten version

None

Contributor guide

Open the contributing guide

Research direction

No files, tests, or entry points are named. Start by locating the existing unit-test result verification and the Spark-style comparison approach, then determine how Flink and Gluten should execute the same tests. Done means their results are compared without manually maintaining expected outcomes as Flink changes.

Written by the indexing model from the issue text.

Assessment

Tech stack
scala, spark
Domain
distributed-systems, testing-qa
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.