bukosabino / bukosabino/scoring-handler

Measure scalability (more than 2 models)

Open
#2 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
HTML
Stars
1
Forks
0
PR merge metrics
No merged PRs in 30d

Description

**Intro**

`FastAPI` provides **native async support** (based on Starlette + Uvicorn), which means we can scale more efficiently the number of models (2 in this case, but we could add some more models to get a further improvement).

**Proposal**

Use the number of models as an input argument to Scoring handler API.

So, we can get more information about the scalability if we run different numbers of models from `Locust` (load testing tool).

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.