apache / apache/datafusion

Provide a helper function for merging statistics

Open
#15,474 1 comment 0 reactions 1 assignee Claimed by @AdamGS View on GitHub
Dominant language
Rust
Stars
9.3k
Forks
2.4k
Avg merge
3d 7h
Merged PRs (30d)
344

Description

The `UnionExec` operator has two helper functions for merging statistics from multiple input operators.
Such a functionality is also needed by my project.

https://github.com/apache/datafusion/blob/fa452e6789194e6da7c3aaf5e2f1ffa5679aacf2/datafusion/physical-plan/src/union.rs#L616-L639

Can we provide a public helper function for merging multiple statistics into a single statistics? This helper function is based on the current `stats_union` and `col_stats_union` functions, and will validate the schema.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.