apache / apache/gluten

[VL] Spark 4.x: Tracking new feature support

Open
#11,910 0 comments 1 reaction 0 assignees View on GitHub
enhancement
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 21h
Merged PRs (30d)
85

Description

## Backend
VL (Velox)

## Description

Umbrella tracking issue for Spark 4.x new features that require Gluten/Velox support.

These are features introduced in Spark 4.0/4.1 that Gluten does not yet support natively. Until supported, affected tests are excluded or disabled. Each child issue tracks a specific feature area.

Parent issue: #8852

Contributor guide

Open the contributing guide

Research direction

Review the child issues linked from this umbrella issue and the parent issue #8852 to identify a specific Spark 4.0/4.1 feature area requiring Gluten/Velox support. Start with the affected tests named in those child issues; completion means the selected feature is supported natively and its affected tests no longer need to be excluded or disabled.

Written by the indexing model from the issue text.

Assessment

Tech stack
scala, spark
Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.