Implement File System-based Metrics Reporter
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
In addition to real-time monitoring metrics, Hudi also has some result metrics, such as IO for clustering reads and writes. These metrics are meaningful for continuously observing the table service status.
However, the existing metrics reporter either outputs to the console or memory without persistence, or it outputs to another metrics server, requiring complex environment setup. We hope to provide a simple persistent reporter where users can specify that the metrics be stored in the file system in JSON format.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-7049
- Type: New Feature
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by locating Hudi's existing metrics reporters and the configuration used to select them. Trace how result metrics such as clustering read and write IO are produced, then define the filesystem reporter's persistence boundary. Done means users can select it and receive metrics stored persistently as JSON files without requiring an external metrics server.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- observability
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 48/100