Create parquet tools clustering execution strategy to integrate clustering with parquet tools libraries
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
Create new clustering execution strategy to integrate clustering with parquet tools libraries. This way command tools like parquet tools, that work at a parquet file level and provide functionality like copy, merge, prune etc can be used.
Ref:
https://mvnrepository.com/artifact/org.apache.parquet/parquet-tools/1.8.0
http://www.mtitek.com/tutorials/bigdata/hadoop/parquet-tools.php
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-3550
- Type: Wish
Contributor guide
No contributing guide indexed for this repository
Research direction
The issue names no files, tests, or entry points. Start by reviewing Hudi's clustering execution strategy and the parquet-tools references linked in the issue; the issue does not define how completion should be verified.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering, distributed-systems
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100