lance-format / lance-format/lance
Blob support in 2.1
Nobody has claimed this yet.
- Dominant language
- Rust
- Stars
- 7.1k
- Forks
- 852
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 272
Description
We should bring over the blob encoding from 2.0 so that we support the same blob API. However, we should also enhance our blob support. Users have requested the ability to read rows as blobs even if the row was not written with the blob encoding. This should be possible. We just need to update the binary decode path to support decoding into descriptions (struct) as well as binary.
- #4372
- Make it possible to read binary/large_binary as blob even if not using structural encoding
- Tests
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Begin by locating the binary decode path described in the issue and compare it with the blob encoding brought over in #4372. Confirm how binary and large_binary rows are decoded, then add coverage for reading rows without structural encoding; done means the requested blob API works and the listed tests pass.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100