lance-format / lance-format/lance
Add support for StringView and BinaryView
Open
Nobody has claimed this yet.
enhancement
- Dominant language
- Rust
- Stars
- 7.1k
- Forks
- 852
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 272
Description
We support the Utf8View data type, but not BinaryView yet.
This type is important because it's used as the storage type for parquet variant. https://github.com/apache/arrow-rs/blob/ec75d000c66609b400dc8a62cf8c8b05afc048a7/parquet-variant-compute/src/variant_array_builder.rs#L440
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the existing Utf8View support in the Rust codebase, then inspect parquet-variant-compute/src/variant_array_builder.rs around the linked usage. Trace how StringView and BinaryView are represented and handled, and confirm completion by covering the parquet variant storage path with the repository's relevant tests.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100