apache / apache/hudi

Implement File System-based Metrics Reporter

Open
#16,296 2 comments 0 reactions 0 assignees View on GitHub
from-jira priority:high status:pr-available type:feature
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

In addition to real-time monitoring metrics, Hudi also has some result metrics, such as IO for clustering reads and writes. These metrics are meaningful for continuously observing the table service status.
However, the existing metrics reporter either outputs to the console or memory without persistence, or it outputs to another metrics server, requiring complex environment setup. We hope to provide a simple persistent reporter where users can specify that the metrics be stored in the file system in JSON format.

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-7049
- Type: New Feature

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating Hudi's existing metrics reporters and the configuration used to select them. Trace how result metrics such as clustering read and write IO are produced, then define the filesystem reporter's persistence boundary. Done means users can select it and receive metrics stored persistently as JSON files without requiring an external metrics server.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
observability
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.