operatorai / operatorai/modelstore
Make model listing faster
Open
Nobody has claimed this yet.
enhancement
- Dominant language
- Python
- Stars
- 403
- Forks
- 29
- PR merge metrics
- No merged PRs in 30d
Description
another nice to have -> some performance (latency) improvements around methods like list_models i haven't had the chance to take an in depth look but at first guess, probably adding async / multithreading for the IO blocking parts or using ujson instead of json for loading the jsons?
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the list_models entry point and reviewing the linked Slack discussion. The issue names no file, test, benchmark, or acceptance target, so first profile the current latency and clarify the intended approach. Done requires an agreed measurable latency improvement.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning, performance
- Issue type
- Refactor
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 28/100