lance-format / lance-format/lance
Need python option in `crate_index` to save the IVF centroids
Open
Nobody has claimed this yet.
A-index
A-python
enhancement
- Dominant language
- Rust
- Stars
- 7.1k
- Forks
- 852
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 272
Description
Or we should always save them to the tmp folder and clearly advertise that they are saved. Otherwise it ends up being somewhat awkward that we have an option to resume training given IVF centroids but no actual way to checkpoint without modifying the code.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names the crate_index Python interface and its IVF-centroid resume-training option, but no files or tests. Start by locating that entry point and tracing how centroid checkpoints are currently resumed; done means there is a clear, usable checkpoint path and its storage behavior is advertised.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, rust
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100