dice-group / dice-group/embeddings.cc
High memory usage ES on 180 mio index
Open
bug
- Dominant language
- Python
- Stars
- 3
- Forks
- 1
- PR merge metrics
- No merged PRs in 30d
Description
Config: New index **dbpedia_wikidata_full** with **179,706,494 entities**
Issue: The server throws an error.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reproducing the server error with the dbpedia_wikidata_full index containing 179,706,494 entities, and capture the exact error and memory usage. Investigate how Elasticsearch handles this index size and document the conditions that trigger the failure. Done means identifying the cause and confirming a reliable fix or configuration change under the reported workload.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- elasticsearch
- Domain
- databases
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100