Simplify configs for immutable datasets
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
For immutable workloads, we have been asking users to set the operation type to "bulk_insert", with "none" sort mode. and optionally disable meta fields if they are running benchmarks. Even other wise, some users miss these documentation. and the fact that it may not be easily discoverable could play a part as well.
So, we should come up w/ a strategy to simplify configs for immutable workloads.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-5819
- Type: Improvement
Contributor guide
No contributing guide indexed for this repository
Research direction
No source files, tests, or entry points are named. Start with the HUDI-5819 context and review the current immutable-workload guidance for bulk_insert, none sort mode, and optional meta-field disabling; done requires a defined strategy that simplifies these configurations.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100