lance-format / lance-format/lance
Rework DataBlock statistics
Open
Nobody has claimed this yet.
enhancement
- Dominant language
- Rust
- Stars
- 7.1k
- Forks
- 852
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 272
Description
- Right now we specify
BlockInfo::new()all over the place. We should have constructors for the various data blocks (or maybe even builders) - Stats are eagerly calculated even if they aren't needed
- When creating new data blocks we sometimes have to call
compute_statand that is confusing. This shouldn't need to be called (probably a corollary of the above point)
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating BlockInfo::new(), compute_stat, and the data-block construction call sites. Review how statistics are calculated and consumed, then determine the intended constructor or builder design. Done means data blocks have appropriate construction APIs, unnecessary statistics are not eagerly calculated, and callers no longer need to invoke compute_stat manually.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- data-engineering
- Issue type
- Refactor
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100