chroma-core / chroma-core/chroma

Does Chroma supports multi replica deployment options at scale ? and what about index types ?

Open
#2,872 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Rust
Stars
29.3k
Forks
2.5k
Avg merge
1d 4h
Merged PRs (30d)
38

Description

We are planing to try and test Chorma Vector DB for a large corpus datasets can go above 100M vectors - 500M and eventually to 1B vectors . At this scale i am looking at deployment options for production level distributed cluster style of deployment for Chroma . From the document official i could only see a docker image that would could install and host it on the servers [It is in alpha state as per the official documentation]. https://cookbook.chromadb.dev/running/deployment-patterns/. Some of the links are not working , can we have the replicas of the pods and will it work. ?

what about load balancing and things like that is there any binary or any other formats we could look at like helm charts or something that we can try it.

Also my assumption is Chroma is mostly a embedabble DB and wanted to know its capabilities in multimodal datasets , does it store the actual image in itself as encoded format ?

We are focused on using 2 Index types : HNSW and DISKANN , does Chorma supports DISKANN ? what all index types it could support and do we have any leverage if we host it on GPU based machines for faster index creation and bulk insert. ?

Need some understanding on how to manage the storage for Chroma , where can we set the parameters on self hosted instance to use a specific volume (block) , or an NFS share or can we provide an S3 object. ?

Did we have any batch limitations and can only push this much at one go. ?

Any inputs is highly appreciated

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue names no source files, tests, or implementation entry point. Start by reviewing the linked cookbook deployment-patterns documentation and inventory the questions about replicas, load balancing, index types, storage, GPU use, and batch limits. Done would require a clearly scoped documentation update or a separated set of actionable issues.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker
Domain
cloud, databases, distributed-systems, infrastructure
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.