nilRAG model is loaded # workers times

Open
#130 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
4/5
Estimated time
3-5 days
Newbie friendliness
35/100
Issue type
Bug
Clarity
Mostly clear
Activity status
Stale
Tech stack
fastapi, python
Domain
ai, backend

Research direction

Start by tracing how the nilRAG models are loaded during FastAPI worker startup and where the worker/container boundary is defined. Confirm the current behavior with multiple workers, then verify that the model is loaded once in a separate container and remains available to the FastAPI workers.

Written by the indexing model from the issue text.

Description

The nilRAG models have had a bug for a long time where they are loaded as many times as workers there are on FastAPI, we need to fix this issue so that the model is loaded only once and in a separate container

Dominant language
Python
Stars
31
Forks
12
No merged PRs in 30d

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from NillionNetwork/nilAI

All issues in NillionNetwork/nilAI

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.