Improve partition pruning during file listing
Open
p1
refactor
- Dominant language
- Rust
- Stars
- 279
- Forks
- 67
- Avg merge
- 3d 1h
- Merged PRs (30d)
- 40
Description
During partition loading (https://github.com/apache/hudi-rs/blob/d90abed1a8d7da54bbde81aad473d4a923b5c597/crates/core/src/table/fs_view.rs#L60) , the file listing can be shortcut by partition pruner to reduce potentially a lot of file listing calls.
Contributor guide
Assessment
This issue has not been assessed yet.