dotnet / dotnet/machinelearning

Bring HNSW for fast approximate nearest Neighbour search

Open
#6,719 2 comments 3 reactions 0 assignees View on GitHub
area-Trainers enhancement untriaged
Dominant language
C#
Stars
9.4k
Forks
2k
Avg merge
2d 20h
Merged PRs (30d)
11

Description

**Is your feature request related to a problem? Please describe.**
LLM uses cosine-similarity to retrieve relevant corpus as memory. While `KNN` is most commonly used to get `k` similar items, it's time-consuming on high-dimension vectors.

HNSW will be much efficient in finding approximate k nearest neighbor on high-dimension dataset. There's a csharp implementation we can probably leverage [HNSW](https://github.com/curiosity-ai/hnsw-sharp)

**Describe the solution you'd like**
A clear and concise description of what you want to happen.

**Describe alternatives you've considered**
A clear and concise description of any alternative solutions or features you've considered.

**Additional context**
Add any other context or screenshots about the feature request here.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.