apache / apache/gravitino

[Improvement] Aggregate partition-level statistics into table-level for partitioned Hive tables

Open
#11,793 0 comments 0 reactions 0 assignees View on GitHub
improvement
Dominant language
Java
Stars
3.2k
Forks
935
Avg merge
1d 17h
Merged PRs (30d)
339

Description

### What would you like to be improved?

When querying a Hive partitioned table through Gravitino's REST API (`GET /api/metalakes/{metalake}/catalogs/{catalog}/schemas/{schema}/tables/{table}`), the `properties` field **does not contain table-level `totalSize`** (and other basic stats) . This is because Gravitino faithfully reflects whatever HMS returns, and HMS has no table-level stats for partitioned tables by default.

### How should we improve?

_No response_

Contributor guide

Open the contributing guide

Research direction

Start at the REST table metadata entry point, GET /api/metalakes/{metalake}/catalogs/{catalog}/schemas/{schema}/tables/{table}, and trace how Gravitino reads table properties from HMS. Determine how partition-level totalSize and other basic statistics should be aggregated, then verify that partitioned-table responses expose the resulting table-level properties.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
api, databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.