microsoft / microsoft/DiskANN

[Question] Can DiskANN support dataset larger than uint32?

Open
#668 2 comments 0 reactions 1 assignee View on GitHub

@suri-kumkaran is already working on this.

Since Feb 8, 2026.

question
Dominant language
Rust
Stars
1.9k
Forks
454
Avg merge
3d 22h
Merged PRs (30d)
35

Description

I see that diskann mainly uses uint32_t to manipulate data (like in .bin file), so the maximum dataset diskann can supoprt is 4 billions. I wonder if there's a way to support dataset larger than 4 billions?

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.