lance-format / lance-format/lance
pack struct with all fixed width fields
Nobody has claimed this yet.
- Dominant language
- Rust
- Stars
- 7.1k
- Forks
- 852
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 272
Description
I wang to create a new page layout for packed struct with all fixed width fields rather than using the current miniblock page layout
reasons:
the decode scheduling logic are different
the 8188 chunk bytes limitation in miniblock layout
why do we still need definition levels in packed struct encoding?
new layout design:
just zip all values.
one byte nulls for number of fields < 8
two bytes nulls for number of fields < 16
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files, tests, or entry points are named. Start by locating the current miniblock page layout and packed struct encoding, then confirm the proposed null-byte rules and what tests would define completion.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100