dice-group / dice-group/embeddings.cc

Indexing/upload seems to use only 1 CPU

Open
#23 0 comments 0 reactions 0 assignees View on GitHub
low-priority
Dominant language
Python
Stars
3
Forks
1
PR merge metrics
No merged PRs in 30d

Description

The `top` command showed peeks up to 100%, going down to around 10% for a short time, continuing afterwards. Overall runs smoothly, but additional CPUs could be used. Currently it is not clear, which component is the bottleneck (ES, nginx, flask?)

Contributor guide

No contributing guide indexed for this repository

Research direction

No files or tests are named. Start by reproducing an indexing/upload run while observing CPU usage with top, then isolate whether Elasticsearch, nginx, or Flask is the bottleneck. Done means the limiting component is identified and the path to using additional CPUs is documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
elasticsearch, flask, nginx, python
Domain
backend, performance
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.