apache / apache/hudi

Underlying multi-storage support

Open
#15,995 2 comments 0 reactions 0 assignees View on GitHub
from-jira priority:high status:pr-available type:bug
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

When the underlying storage is multiple, such as hdfs, minio, obs, etc., we need to dynamically upload parameters to the underlying file system through catalog, so we cannot obtain parameters only through environment variables

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-6306
- Type: Bug

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no source files, tests, or entry points. Start by tracing how catalog configuration and environment-variable parameters reach the underlying HDFS, MinIO, or OBS storage, then identify the affected storage configuration path. Done means parameters can be supplied dynamically through the catalog for each supported underlying storage rather than only through environment variables.

Written by the indexing model from the issue text.

Assessment

Tech stack
hadoop, java
Domain
data-engineering
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.