lance-format / lance-format/lance
Support variable shape tensor
Open
Nobody has claimed this yet.
enhancement
- Dominant language
- Rust
- Stars
- 7.1k
- Forks
- 852
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 272
Description
The layout was approved back in September: https://lists.apache.org/thread/8s9s9smclhztkqj3sn4y6f6hp06b3163
We could make our own Python extension type for now until PyArrow releases theirs.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the approved layout discussion linked in the issue and determine the intended representation for variable-shape tensors. Then assess whether a Python extension type is needed until PyArrow provides one; done means the chosen representation is supported consistently by the project and its Python interface.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, rust
- Domain
- data, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100