michaelfeil / michaelfeil/infinity
Binary quantization - evaluate quality
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 2.9k
- Forks
- 206
- PR merge metrics
- No merged PRs in 30d
Description
### Feature request
Is there a way of receiving the embeddings back in BQ format? Right now, I receive the full precision embedding and quantize it in the client, but wondering if I'm missing a way to get this directly from the server in binary format? If static quantization is done at zero, then there's no need to profile the data so the server can still remain stateless.
### Motivation
More compact response from server.
### Your contribution
N/A
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no files, tests, or entry points. Start by locating the server's embedding response path and any existing quantization support, then evaluate whether static binary quantization can be returned directly; done means a defined binary response format with measured embedding quality and a compact server response.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- api, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100