apache / apache/hudi

Support aggregation model

Open
#15,540 0 comments 0 reactions 0 assignees View on GitHub
area:core from-jira priority:high type:feature
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

Refer to the aggregation model in apache doris: https://doris.apache.org/docs/data-table/data-model#example-1-importing-data-aggregation
```sql
CREATE TABLE IF NOT EXISTS example_db.expamle_tbl
(
`user_id` LARGEINT NOT NULL COMMENT "user id",
`date` DATE NOT NULL COMMENT "data import time",
`city` VARCHAR(20) COMMENT "city",
`age` SMALLINT COMMENT "age",
`sex` TINYINT COMMENT "gender",
`last_visit_date` DATETIME REPLACE DEFAULT "1970-01-01 00:00:00" COMMENT "last visit date time",
`cost` BIGINT SUM DEFAULT "0" COMMENT "user total cost",
`max_dwell_time` INT MAX DEFAULT "0" COMMENT "user max dwell time",
`min_dwell_time` INT MIN DEFAULT "99999" COMMENT "user min dwell time"
)
AGGREGATE KEY(`user_id`, `date`, `city`, `age`, `sex`)
DISTRIBUTED BY HASH(`user_id`) BUCKETS 1
PROPERTIES (
"replication_allocation" = "tag.location.default: 1"
);
```
 

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-5152
- Type: New Feature

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing the linked HUDI-5152 JIRA issue and the Apache Doris aggregation-model example in the issue body. No Hudi files, tests, entry points, or acceptance criteria are named, so the implementation scope and definition of done need to be established before work can begin.

Written by the indexing model from the issue text.

Assessment

Tech stack
sql
Domain
data-engineering, databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.