apache / apache/hudi

show fsview all, show fsview latest, returns empty results on hdfs

Open
#15,574 0 comments 0 reactions 0 assignees View on GitHub
component:cli from-jira priority:high type:devtask
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

hudi:hudi_trips_mor->show fsview all
╔═══════════╤════════╤══════════════╤═══════════╤════════════════╤═════════════════╤═══════════════════════╤═════════════╗
║ Partition │ FileId │ Base-Instant │ Data-File │ Data-File Size │ Num Delta Files │ Total Delta File Size │ Delta Files ║
╠═══════════╧════════╧══════════════╧═══════════╧════════════════╧═════════════════╧═══════════════════════╧═════════════╣
║ (empty) ║
╚═════════════════
2:03
hudi:hudi_trips_mor->show fsview latest
╔═══════════╤════════╤══════════════╤═══════════╤════════════════╤═════════════════╤══════════════════╤═══════════════════════════════════╤═════════════════════════════════════╤════════════════════════════════════════════╤══════════════════════════════════════════════╤════════════════════════════════════╤══════════════════════════════════════╗
║ Partition │ FileId │ Base-Instant │ Data-File │ Data-File Size │ Num Delta Files │ Total Delta Size │ Delta Size - compaction scheduled │ Delta Size - compaction unscheduled │ Delta To Base Ratio - compaction scheduled │ Delta To Base Ratio - compaction unscheduled │ Delta Files - compaction scheduled │ Delta Files - compaction unscheduled ║
╠═══════════╧════════╧══════════════╧═══════════╧════════════════╧═════════════════╧══════════════════╧═══════════════════════════════════╧═════════════════════════════════════╧════════════════════════════════════════════╧══════════════════════════════════════════════╧════════════════════════════════════╧══════════════════════════════════════╣
║ (empty) ║
╚════════════════════════════════

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-5225
- Type: Task

Contributor guide

No contributing guide indexed for this repository

Research direction

Reproduce the issue by running `show fsview all` and `show fsview latest` for `hudi_trips_mor` on HDFS. Trace the filesystem-view handling to determine why both commands return empty results; done when they display the expected file-system view rows.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.