apache / apache/gluten

[VL] Add vanilla unit tests from Delta Lake

Open
#11,106 2 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

### Description

We can maintain copies of essential Delta Lake tests in Gluten's code base for coverage of Gluten + Delta.

Moving forward, we may need a way to leverage Delta's unit tests with less code change to Gluten. Maybe by downloading the test code during compilation time, or by release a test jar by ourselves.

### Gluten version

None

Contributor guide

Open the contributing guide

Research direction

Start by reviewing Gluten's existing test layout and the Delta Lake unit tests the issue proposes copying. Compare the required Gluten changes and assess whether compilation-time downloads or a separately released test JAR is viable. Done means an agreed approach is implemented with essential Delta coverage running in Gluten.

Written by the indexing model from the issue text.

Assessment

Tech stack
scala, spark
Domain
data-engineering, testing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.