apache / apache/hudi

[SUPPORT] Support setting the maximum number of partitions for a table

Open
#11,566 6 comments 0 reactions 0 assignees View on GitHub
type:feature
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

Many companies have Hive tables with tens or even hundreds of thousands of partitions. This is because data warehouse developers do not understand the use of partitions. If the number of partitions can be limited, irregular use can be better restricted.

Contributor guide

No contributing guide indexed for this repository

Research direction

No files, tests, or entry points are identified in the issue. First locate the table-partition creation and configuration paths, then determine how a maximum partition count should be configured and enforced; done should include coverage for tables that exceed the limit.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering, databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.