apache / apache/datafusion-comet
Skip the merge wrapper for single-file partitions
Open
area:scan
enhancement
- Dominant language
- Scala
- Stars
- 1.3k
- Forks
- 373
- Avg merge
- 2d 4h
- Merged PRs (30d)
- 198
Description
### What is the problem the feature request solves?
Follow up for #5323
When a partition has only one file, we still wrap the scan in SortPreservingMergeExec, which is a no-op merge. We can skip the wrapper in that case to avoid the small overhead.
### Describe the potential solution
_No response_
### Additional context
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.