[VL] Add vanilla unit tests from Delta Lake
- Dominant language
- Scala
- Stars
- 1.6k
- Forks
- 657
- Avg merge
- 2d 14h
- Merged PRs (30d)
- 80
Description
### Description
We can maintain copies of essential Delta Lake tests in Gluten's code base for coverage of Gluten + Delta.
Moving forward, we may need a way to leverage Delta's unit tests with less code change to Gluten. Maybe by downloading the test code during compilation time, or by release a test jar by ourselves.
### Gluten version
None
Contributor guide
Research direction
Start by reviewing Gluten's existing test layout and the Delta Lake unit tests the issue proposes copying. Compare the required Gluten changes and assess whether compilation-time downloads or a separately released test JAR is viable. Done means an agreed approach is implemented with essential Delta coverage running in Gluten.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- scala, spark
- Domain
- data-engineering, testing
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100