AnswerDotAI / AnswerDotAI/RAGatouille

Support two indexing styles: ColBERT/PLAID style optimisation and HNSW-style uncompressed indexes

Open
#110 1 comment 0 reactions 1 assignee Claimed by @bclavie View on GitHub
enhancement help wanted Indexing expansion
Dominant language
Python
Stars
4k
Forks
276
PR merge metrics
No merged PRs in 30d

Description

Currently, we only use the ColBERT optimised indexes, or index-free in-memory encodings.

For low-to-medium volumes of documents, not using the ColBERT optimisation can have advantages: easier CRUD, potentially better performance, the concept is easier to grasp, quicker indexing time... (and tradeoffs: much bigger footprint, no constant-time querying, etc...)

We should provide the ability to create both kinds of indexes, and let the user decide which indexing style they wish to use.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.