4paradigm / 4paradigm/OpenMLDB

Support table aggregation functions for Batch mode

Open
#410 1 comment 0 reactions 1 assignee Claimed by @tobegit3hub View on GitHub
enhancement
Dominant language
C++
Stars
1.7k
Forks
331
Avg merge
12d 12h
Merged PRs (30d)
1

Description

Now OpenMLDB core support generate physical plan for table aggregation functions. We should add support for batch mode by generate planner to run table aggregation functions over Spark dataframes.

Contributor guide

Open the contributing guide

Research direction

The issue mentions extending OpenMLDB's core to support table aggregation functions in batch mode via Spark dataframes. Start by examining the existing physical plan generation for table aggregation functions in the core codebase. Look for Spark integration points and dataframe handling. Determine what changes are needed in the planner to generate appropriate Spark jobs. Testing will involve verifying the new batch mode works with existing aggregation functions.

Written by the indexing model from the issue text.

Assessment

Tech stack
spark
Domain
backend, databases, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.