AnswerDotAI / AnswerDotAI/RAGatouille

Use Matryoshka + Binary Quantisation Embeddings

Open
#260 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
4k
Forks
276
PR merge metrics
No merged PRs in 30d

Description

Ragatouille supports using models for encoding trained on Matryoshka embeddings but I wasn't able to find a way to use them for indexing. Secondly although ragatouille supports storing compressed vectors to disk but it would be great to combine them with binary/int 8 quantised embeddings. Would love to contribute if it's feasible.

Contributor guide

No contributing guide indexed for this repository

Research direction

No files or tests are named. Start by locating the indexing path and the existing compressed-vector storage implementation, then determine how Matryoshka dimensions and binary or int8 quantisation would flow through them. Done means both embedding approaches are supported for indexing and their stored-vector behavior is covered by tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning, search
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.