apache / apache/gluten

[VL] Add support for theta sketch based aggregate/scalar functions

Open
#12,109 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

### Description

Spark introduced these functions in 4.1. This support may not be urgent, depending on how many users actually rely on them.

Spark PR: https://github.com/apache/spark/pull/51298

Contributor guide

Open the contributing guide

Research direction

Start with the linked Apache Spark PR #51298 to identify the theta sketch aggregate and scalar functions being added. Trace how corresponding functionality is exposed in Gluten and its native execution layer, then verify that the listed functions are supported and covered by the relevant tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
scala, spark
Domain
data
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.