lance-format / lance-format/lance
Make a SVD implementation in Rust and remove the dependency of openblas
Open
Nobody has claimed this yet.
A-index
enhancement
good first issue
help wanted
rust
- Dominant language
- Rust
- Stars
- 7.1k
- Forks
- 852
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 272
Description
Problem Statement
openblas gives us many troubles to build the package in different systems. We only use blas to compute SVD in OPQ now. Because it is only used during indexing, SVD / blas is not performance critical piece of code. It should be safe to remove them.
Desired behavior
We implement SVD in rust, and get rid of openblas-src as dependency.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the OPQ indexing code that currently uses BLAS for SVD, then find all references to openblas-src. Review the existing SVD call path and its indexing-only constraints. Done means a Rust SVD implementation replaces that usage and openblas-src is no longer a dependency.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- machine-learning
- Issue type
- Refactor
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 30/100