lance-format / lance-format/lance
Column Statistics
Open
Nobody has claimed this yet.
enhancement
- Dominant language
- Rust
- Stars
- 7.1k
- Forks
- 852
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 272
Description
We should expose column statistics for columns. At a minimum this should include the minimum, maximum, and null count. However, other statistics such as median, quantiles, histograms, lists of unique values, NaN count, may be included as well.
These will be useful both internally (for planning) as well as externally (for users)
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no files, tests, or entry points; begin by locating how column metadata is represented and consumed. Done means defining and exposing at least minimum, maximum, and null count statistics, with the chosen additional statistics and behavior documented or tested.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- data-engineering, databases
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100