apache / apache/gluten

Functionality verification for spark class overwritten by gluten in fallback situation

Open
#3,362 2 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

### Description

We have a few spark classes introduced into Gluten with some code changes. We should make sure they work well in fallback situation and be careful when introducing some new spark class.

In addition, as the introduced spark class is always based on a certain spark version, there may have issue when running gluten on some other spark versions. For example, we allow Gluten running on spark 3.2.x. As some imported spark class is based on spark 3.2.2, if it is incompatible between spark 3.2.2 and others, some runtime issues can happen.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.