apache / apache/datafusion-comet
Reading Iceberg tables show 0.0B for the Input column on Spark's executor UI
Open
area:scan
bug
priority:low
- Dominant language
- Scala
- Stars
- 1.3k
- Forks
- 373
- Avg merge
- 2d 6h
- Merged PRs (30d)
- 190
Description
### Describe the bug
`spark.comet.scan.icebergNative.enabled=true`
`spark.comet.scan.icebergNative.enabled=false`
### Steps to reproduce
`SELECT COUNT(DISTINCT(col_string)) FROM $ICEBERG_TABLE WHERE ... (predicates)`
### Expected behavior
`CometIcebergNativeScan` should also report input size per executor.
### Additional context
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.