apache / apache/datafusion

Better not to display partitions info for ParquetExec

Open
#2,964 4 comments 1 reaction 0 assignees View on GitHub
enhancement
Dominant language
Rust
Stars
9.3k
Forks
2.4k
Avg merge
3d 7h
Merged PRs (30d)
344

Description

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**

Suppose there're tens of thousands of files needs to be scanned for one SQL. The shown partitions info for the "Physical plan with metrics" will be too messy. And it's also meaningless to show the partitions info because we have already had the filename for the specific ParquetExec task.

**Describe the solution you'd like**

Therefore, it's better not to show the partitions info.

**Describe alternatives you've considered**

**Additional context**

Contributor guide

Open the contributing guide

Research direction

No file or test is named. Start by locating the ParquetExec physical-plan metrics display and trace how partition information is rendered; done means the physical plan no longer prints partitions for ParquetExec while still showing the filename for the specific task.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
backend
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.