dowhiledev / dowhiledev/nomos

Synchronous in session.next()

Open
#183 1 comment 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
88
Forks
12
PR merge metrics
No merged PRs in 30d

Description

Thank team Nomos for the contributions to this project.

I’m currently facing an issue: when the FastAPI server’s worker count is set to 1, the requests to “send a message to an existing session” are always blocked and executed sequentially.

From what I’ve researched, the problem seems to come from the fact that session.next() is written as synchronous (all methods in the Session class are synchronous).

As a result, the system cannot scale effectively, since the number of concurrent requests is limited by the number of available workers.

Please let me know if I might be mistaken here — I’d really appreciate your feedback.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.