lablup / lablup/backend.ai

Add P2C load balancing scheme to App Proxy

Open
#5,299 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
670
Forks
183
Avg merge
17h 7m
Merged PRs (30d)
358

Description

P2C (power of two choices) is a standard-ish load balancing mechanism used in Traefik by default.

We chose WRR (weighted round robin) to allow dynamic reconfiguration of replicas, but for the purpose of stable services, it may be better to use a more “stable” load balancing scheme that has less skews time to time.

refs)

- [https://go-zero.dev/en/docs/tutorials/service/governance/lb#p2cpower-of-two-choices](https://go-zero.dev/en/docs/tutorials/service/governance/lb#p2cpower-of-two-choices)

This work will be a revisit of [PR #3221.](https://github.com/lablup/backend.ai/pull/3221)

JIRA Issue: BA-1989

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.